-- Logs begin at Thu 2022-09-29 01:31:22 UTC, end at Thu 2022-09-29 02:40:42 UTC. -- Sep 29 02:04:03.239148 dv-cinder-733062-36-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 29 02:04:03.248087 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 29 02:04:03 2022] *** Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: nodename: dv-cinder-733062-36-iscsi Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: machine: x86_64 Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: clock source: unix Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: pcre jit disabled Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: detected number of CPU cores: 4 Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: current working directory: / Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: detected binary path: /usr/bin/uwsgi-core Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: your processes number limit is 47680 Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: your memory page size is 4096 bytes Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: detected max file descriptor number: 2048 Sep 29 02:04:03.250148 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: lock engine: pthread robust mutexes Sep 29 02:04:03.251107 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: thunder lock: enabled Sep 29 02:04:03.251107 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 29 02:04:03.251107 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 29 02:04:03.288832 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: Python main interpreter initialized at 0x558f4c5bc9c0 Sep 29 02:04:03.288832 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: python threads support enabled Sep 29 02:04:03.288832 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: your server socket listen backlog is limited to 100 connections Sep 29 02:04:03.288832 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: your mercy for graceful operations on workers is 90 seconds Sep 29 02:04:03.289207 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: mapped 403077 bytes (393 KB) for 2 cores Sep 29 02:04:03.289207 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: *** Operational MODE: preforking *** Sep 29 02:04:03.289506 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: *** uWSGI is running in multiple interpreter mode *** Sep 29 02:04:03.289506 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: spawned uWSGI master process (pid: 105707) Sep 29 02:04:03.289689 dv-cinder-733062-36-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 29 02:04:03.290270 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: spawned uWSGI worker 1 (pid: 105708, cores: 1) Sep 29 02:04:03.291046 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: spawned uWSGI worker 2 (pid: 105709, cores: 1) Sep 29 02:04:03.291046 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 29 02:04:03.934119 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 29 02:04:03.940248 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 29 02:04:04.997220 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:04:04.997220 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: from cryptography.utils import int_from_bytes Sep 29 02:04:04.997850 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:04:04.997850 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: from cryptography.utils import int_from_bytes Sep 29 02:04:05.003921 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:04:05.003921 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: from cryptography.utils import int_from_bytes Sep 29 02:04:05.004420 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:04:05.004420 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: from cryptography.utils import int_from_bytes Sep 29 02:04:07.533461 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 02:04:07.534065 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 02:04:07.534310 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 02:04:07.534600 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 02:04:07.534848 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 02:04:07.535220 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.535520 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.535840 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.536095 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 02:04:07.536512 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.536608 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 02:04:07.536677 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.536742 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.536889 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 02:04:07.537051 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.537248 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 02:04:07.537379 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.537477 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 02:04:07.537604 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.537871 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538065 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538157 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538253 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538503 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-36-iscsi {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538647 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538799 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.538901 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539096 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539185 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539394 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539482 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539699 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.539996 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.540084 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.540308 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.540401 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.540564 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.540651 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.540876 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.541086 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.541196 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-36-iscsi {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.542322 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.542693 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.542822 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.542952 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.542952 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543182 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543182 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543418 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543548 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543665 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543665 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.543893 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544010 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544134 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544260 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544369 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544513 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544644 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544762 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.544877 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545000 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-36-iscsi {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545139 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545258 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545374 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545499 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545627 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545777 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.545908 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.546036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.546167 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.546821 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.546959 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547079 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547184 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547294 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547397 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547505 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547630 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-36-iscsi {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547742 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.547844 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548032 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548139 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548240 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548348 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548450 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548708 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548852 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.548968 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.549071 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.549257 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.549370 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550035 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550187 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550339 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550467 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550594 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550720 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550853 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.550983 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551102 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551220 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551345 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551478 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551606 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551726 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551846 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.551972 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552099 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552230 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552376 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552513 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552634 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552763 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552882 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.552995 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553119 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553239 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553368 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553493 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553612 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553738 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553857 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.553976 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.555706 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.556422 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.556558 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.556691 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.556814 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.556942 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557062 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557191 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557321 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557442 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557576 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557696 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557825 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.557957 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558207 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558342 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558460 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558578 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558917 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.558917 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559149 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559149 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559390 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559517 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559648 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559772 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.559891 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560007 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560124 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560253 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560373 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560498 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560703 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560824 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.560942 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561072 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561199 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561319 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561319 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561557 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561557 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561794 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.561910 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562090 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562090 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562336 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562465 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562583 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562700 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562818 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.562935 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563051 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563177 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563295 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563412 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563537 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563655 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563771 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.563901 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564020 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564137 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564253 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564369 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564496 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564640 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564768 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.564885 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565009 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565133 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565259 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565385 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565502 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565620 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565737 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565853 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.565977 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566118 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566235 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566352 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566467 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566636 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566769 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.566888 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567006 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567239 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567368 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567487 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567605 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567728 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567858 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.567977 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568093 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568279 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568414 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568533 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568659 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568856 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.568992 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.569123 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.569241 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.569439 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.569573 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.569756 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.569899 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570102 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570231 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570406 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570532 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570660 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570813 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.570987 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571119 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571238 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571359 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571548 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571681 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571863 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.571990 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.572119 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.572237 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.572431 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.572564 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.572712 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.572846 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573016 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573141 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573292 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573496 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573634 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573777 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.573965 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.574246 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.574406 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.574526 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.574644 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.574782 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.574915 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575037 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575162 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575283 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575399 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575516 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575632 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575748 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.575898 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.576022 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.576208 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.576329 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.576538 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.576668 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.576835 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.576958 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.577136 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.577258 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.577435 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.577565 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.577731 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.577945 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.578127 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.578289 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.578447 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.578606 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.578738 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.578912 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.579035 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.579215 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.579344 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.579531 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.579655 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:04:07.579833 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.579954 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.580135 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.580256 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.580437 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.580576 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.580745 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.580863 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581053 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581183 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581373 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581495 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581681 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581804 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.581987 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.582142 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.582316 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.582460 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.582621 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.582747 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.582928 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583059 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583248 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583370 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583558 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583686 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583859 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.583989 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.584186 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.584306 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.584512 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.584649 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.584816 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.584947 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.585128 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.585255 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.585441 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.585562 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.585742 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.585880 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586063 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586187 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586366 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586505 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586691 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586813 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.586994 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.587113 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.587294 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.587422 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.587604 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.587728 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.587905 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588026 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588229 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588351 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588531 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588655 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588831 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.588952 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.589132 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.589323 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.589515 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.589716 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.589897 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590055 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590177 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590310 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590431 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590549 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590713 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.590861 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591018 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591155 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591336 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591461 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591614 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591768 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.591898 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592075 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592200 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592380 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592511 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592686 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592817 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.592992 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.593115 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.593323 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.593444 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.593622 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.593743 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.593919 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594061 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594262 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594397 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594569 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594700 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594861 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.594983 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.595175 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.595304 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.595471 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.595675 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.595797 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.595915 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596040 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596158 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596342 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596474 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596638 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596767 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.596939 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597068 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597235 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597365 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597531 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597651 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597844 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.597966 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.598180 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.598312 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.598477 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.598607 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.598791 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.598913 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599188 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599324 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599445 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599572 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599691 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599807 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.599958 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600083 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600257 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600386 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600559 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600681 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600857 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.600979 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.601165 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.601291 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.601466 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.601598 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.601764 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.601885 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.602103 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.602241 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.602407 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.602538 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.602708 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.602831 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603017 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603147 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603324 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603461 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603629 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603758 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.603925 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604048 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604226 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604363 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604520 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604642 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604834 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.604955 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.605136 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.605296 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.605418 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.605631 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.605752 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.605960 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.606172 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.606306 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.606439 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.606580 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.606700 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.606878 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607008 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607190 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607311 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607488 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607609 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607778 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.607907 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608076 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608205 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608371 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608493 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608668 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608790 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.608971 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609094 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609270 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609393 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609567 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609693 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.609986 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.610188 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.610312 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.610489 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.610621 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.610806 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.610926 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.611107 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.611226 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.611406 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.611527 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.611704 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.611833 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612000 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612130 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612308 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612430 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612607 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612730 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.612912 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613043 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613210 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613332 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613520 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613641 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613818 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.613942 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.614156 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.614279 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.614451 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.614589 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.614759 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.614891 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615067 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615188 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615372 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615494 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615675 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615804 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.615984 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.616104 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.616281 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.616410 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.616584 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.616713 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.616880 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617011 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617176 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617298 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617473 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617596 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617769 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.617900 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618100 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618235 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618396 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618527 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618700 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618822 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.618997 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.619126 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.619306 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.619430 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.619600 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.619722 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.619904 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.620039 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.620196 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.620326 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.620553 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.620683 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.620872 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621001 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621193 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621308 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621491 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621614 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621791 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.621922 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.622127 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.622252 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.622429 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.622552 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.622729 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.622859 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623030 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623146 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623324 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623454 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623654 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623776 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.623893 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624010 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624196 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624325 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624496 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624627 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624794 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.624915 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625087 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625219 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625392 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625516 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625688 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625818 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.625981 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.626148 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.626280 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.626400 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.626584 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.626705 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.626895 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627024 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627196 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627318 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627508 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627627 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627816 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.627945 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.628114 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.628237 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.628408 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.628530 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.628706 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.628835 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629004 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629117 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629295 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629422 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629588 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629723 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.629877 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630019 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630206 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630334 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630519 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630650 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630814 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.630935 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.631118 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.631239 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.631428 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.631551 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.631726 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.631847 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632074 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632210 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632337 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632456 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632607 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632731 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.632917 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633040 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633215 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633336 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633509 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633637 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633809 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.633931 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.634120 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.634242 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.634419 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.634622 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.634745 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.634870 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635015 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635137 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635312 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635435 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635613 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635745 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.635911 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636067 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636238 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636366 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636561 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636695 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636869 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.636990 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.637175 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.637479 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.637599 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.637787 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.637911 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.638114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.638238 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.638419 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.638551 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.638735 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.638856 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639041 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639174 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639347 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639470 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639652 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639775 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.639952 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.640074 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.640298 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.640424 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.640551 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.640669 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.640839 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.641129 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.641252 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.641429 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.641557 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.641723 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.641846 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642035 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642161 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642337 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642470 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642642 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642774 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.642935 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643063 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643228 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643343 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643522 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643652 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643817 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.643939 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.644121 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.644242 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.644419 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.644549 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.644720 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.644842 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645015 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645146 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645326 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645447 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645624 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645746 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.645916 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.646076 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.646234 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.646357 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.646526 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.646649 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.646825 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647024 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647146 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647263 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647415 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647536 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647734 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.647869 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648037 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648159 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648343 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648472 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648642 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648767 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.648953 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649075 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649247 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649368 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649543 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649665 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649838 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.649959 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.650159 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.650295 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.650456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.650579 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.650749 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.650870 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.651046 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.651169 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.651341 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.651464 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.651641 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.651833 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.652104 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.652254 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.652407 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.652529 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.652728 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.652849 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653029 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653163 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653330 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653446 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653629 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653751 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.653935 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654229 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654353 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654470 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654587 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654704 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654830 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.654949 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.655131 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.655254 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.655432 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.655552 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.655727 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.655859 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656022 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656143 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656315 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656435 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656611 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656735 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.656905 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657040 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657205 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657326 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657508 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657629 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657800 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.657922 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.658124 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.658246 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.658427 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.658556 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.658720 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.658842 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659014 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659143 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659310 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659431 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659604 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659724 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.659896 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660030 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660192 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660320 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660490 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660612 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660794 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.660934 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661085 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661206 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661384 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661511 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661677 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661810 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.661972 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662151 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662282 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662401 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662575 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662698 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662867 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.662991 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.663160 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.663283 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.663454 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.663571 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.663746 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.663867 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664038 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664160 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664350 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664473 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664649 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664772 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.664940 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665061 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665234 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665364 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665525 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665647 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665822 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.665956 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.666150 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.666275 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.666449 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.666571 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.666748 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.666880 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.667048 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.667170 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.667437 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.667570 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.667766 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.667986 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668116 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668235 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668354 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668478 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668618 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668752 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.668913 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669041 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669209 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669334 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669510 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669631 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669802 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.669924 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.670120 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.670244 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.670433 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.670558 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.670735 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.670856 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671037 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671158 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671349 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671476 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671660 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671775 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.671968 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672087 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672263 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672391 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672564 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672685 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672865 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.672989 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.673162 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.673290 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.673461 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.673583 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.673760 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.673888 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.674083 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.674219 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.674387 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.674508 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.674687 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.674884 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675006 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675123 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675272 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675572 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675709 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675873 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.675994 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.676173 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.676294 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.676469 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.676599 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.676774 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.676894 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677075 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677195 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677372 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677502 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677673 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677803 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.677967 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.678113 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.678295 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.678417 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.678593 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.678720 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.678897 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679030 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679202 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679324 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679507 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679622 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679813 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.679948 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.680116 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.680574 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.680784 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.680906 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681086 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681214 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681386 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681507 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681682 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681802 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.681985 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.682159 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.682317 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.682447 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.682621 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.682742 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683179 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683390 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683512 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683686 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.683988 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.684118 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.684295 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.684417 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.684589 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.684710 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.684886 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685010 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685182 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685303 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685483 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685603 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685778 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.685900 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.686095 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.686229 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.686505 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.686627 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.686807 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.686939 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.687107 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.687228 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.687413 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.687543 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.687720 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.687842 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688043 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688164 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688344 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688474 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688645 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688767 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.688944 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.689065 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.689261 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.689398 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.689561 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.689682 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.689864 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690037 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690203 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690329 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690520 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690650 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690825 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.690955 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.691132 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.691294 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.691418 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.691608 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.691731 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.691917 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.692041 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.692237 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.692368 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.692557 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.692679 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.692878 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693000 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693183 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693314 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693494 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693616 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693803 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.693924 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.694150 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.694286 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.694476 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.694599 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.694778 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.694898 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695079 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695214 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695374 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695496 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695794 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.695984 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.696108 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.696279 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.696401 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.696581 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.696705 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.696881 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697005 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697178 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697309 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697473 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697595 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697767 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.697899 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.698115 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.698239 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.698411 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.698533 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.698768 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.698902 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.699148 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.699270 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.699471 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.699604 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.699773 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.699901 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700067 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700196 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700381 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700511 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700678 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700799 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.700971 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701094 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701265 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701401 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701560 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701683 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701858 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.701980 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.702198 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.702332 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.702496 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.702616 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.702813 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.702937 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.703124 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.703257 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.703422 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.703543 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.703741 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.703877 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704042 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704164 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704350 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704471 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704652 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704774 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.704951 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705073 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705252 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705383 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705546 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705667 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705838 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.705976 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.706162 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.706290 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.706457 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.706592 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.706751 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.706875 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707046 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707163 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707343 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707473 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707638 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707761 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.707932 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708054 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708231 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708362 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708542 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708667 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708837 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.708959 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.709151 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.709282 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.709450 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.709572 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.709746 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.709869 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710061 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710189 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710355 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710479 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710685 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710808 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.710982 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.711104 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.711284 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.711415 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.711585 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.711706 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.711881 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712004 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712178 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712299 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712481 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712601 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712785 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.712915 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713091 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713211 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713397 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713568 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713699 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713819 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.713985 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.714131 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.714348 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.714550 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.714717 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.714916 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715115 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715278 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715399 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715533 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715655 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715771 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.715889 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716006 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716181 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716313 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716497 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716620 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716811 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.716933 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.717122 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.717246 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.717437 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.717562 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.717749 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.717871 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718079 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718217 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718383 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718505 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718685 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718809 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.718996 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.719126 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.719308 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.719437 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.719625 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.719818 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.719949 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.720145 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.720267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.720458 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.720579 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.720774 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.720896 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.721062 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.721185 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.721370 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.721501 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.721679 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.721805 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722191 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722305 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722430 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722612 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722735 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.722918 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723049 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723222 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723380 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723525 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723647 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723833 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.723956 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.724138 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.724269 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.724444 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.724568 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.724744 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.724866 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725049 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725182 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725352 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725474 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725667 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725789 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.725989 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.726139 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.726313 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.726445 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.726617 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.726752 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.726922 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.727048 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.727228 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.727350 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.727532 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.727731 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.727860 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728038 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728162 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728362 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728484 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728678 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728802 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.728992 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.729118 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.729299 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.729430 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.729604 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.729727 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.729992 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.730201 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.730369 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.730553 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.730722 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.730890 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.731067 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.731222 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.731408 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.731606 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.731793 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.731980 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.732158 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.732158 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.732542 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.732542 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.732916 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.733186 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.733381 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.733575 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.733787 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.733984 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.734251 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.734450 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.734647 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.734861 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.735080 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.735290 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.735482 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.735665 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.735665 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.736022 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.736226 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.736419 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.736612 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.736802 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.736998 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.737187 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.737396 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.737610 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.737610 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.737982 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.737982 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.738394 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.738394 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.738787 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.738936 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739057 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739179 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739308 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739429 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739429 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739655 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739781 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.739901 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740027 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740147 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740256 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740413 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740534 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740663 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740791 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.740911 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741028 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741145 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741262 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741392 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741512 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741629 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741747 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741872 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.741990 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742148 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742269 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742387 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742504 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742629 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742756 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.742884 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743011 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743130 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743247 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743364 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743489 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743616 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743735 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743861 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.743982 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744101 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744238 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744359 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744477 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744594 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744711 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744830 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.744956 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745075 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745193 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745310 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745578 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745705 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745825 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.745944 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746115 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746235 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746352 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746482 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746602 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746706 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746823 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.746941 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747068 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747196 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747314 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747431 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747548 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747735 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.747866 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748037 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748160 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748359 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748482 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748658 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748792 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.748959 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749091 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749256 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749380 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749559 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749689 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749860 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.749982 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.750190 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.750326 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.750494 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.750616 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.750791 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.750912 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.751096 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.751219 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.751399 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.751647 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.751769 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.751974 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.752097 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.752276 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.752407 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.752574 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.752705 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.752873 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753004 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753174 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753301 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753479 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753602 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753777 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.753899 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.754101 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.754233 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.754413 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.754534 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.754722 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.754845 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755026 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755150 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755329 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755450 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755631 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755760 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.755963 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756083 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756209 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756328 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756503 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756636 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756802 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.756924 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.757105 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.757227 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.757408 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.757540 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.757713 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.757835 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.758055 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.758182 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.758338 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.758649 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.758772 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.758986 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.759108 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.759295 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.759425 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.759604 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.759724 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.759906 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760098 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760224 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760350 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760504 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760630 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760808 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.760942 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.761194 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.761330 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.761500 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.761624 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.761822 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.761992 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.762175 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.762352 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.762496 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.762663 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.762813 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.762964 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.763115 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.763412 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.763640 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.763764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.763951 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764073 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764269 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764393 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764575 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764695 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764869 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.764999 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.765162 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.765284 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.765462 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.765591 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.765755 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.765888 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766076 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766212 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766373 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766496 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766798 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.766965 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767095 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767257 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767378 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767553 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767684 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767850 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.767973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.768143 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.768264 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.768435 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.768559 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.768727 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.768849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769026 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769156 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769319 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769443 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769611 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769735 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.769902 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770057 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770219 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770344 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770513 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770634 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770834 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.770965 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.771158 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.771280 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.771455 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.771577 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.771759 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.771893 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772058 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772189 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772358 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772484 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772656 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772794 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.772954 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773078 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773252 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773381 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773549 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773679 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773848 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.773969 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.774169 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.774300 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.774468 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.774592 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.774764 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.774886 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775062 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775191 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775359 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775492 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775657 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775779 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.775960 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.776095 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.776276 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.776407 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.776591 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.776759 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.776959 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.777103 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.777288 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.777413 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.777597 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.777718 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.777917 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.778101 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.778265 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.778389 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.778569 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.778691 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.778877 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779007 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779182 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779303 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779482 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779604 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.779916 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780085 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780208 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780385 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780518 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780690 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780813 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.780988 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.781110 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.781287 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.781409 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.781594 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.781718 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.781898 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782039 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782239 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782362 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782552 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782684 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782853 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.782980 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.783166 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.783296 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.783521 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.783652 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.783799 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.783926 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784101 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784301 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784423 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784540 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784692 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784815 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.784995 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.785128 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.785298 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.785420 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.785594 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.785715 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.785841 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105708) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 02:04:07.785970 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.786215 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.786525 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.786840 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.787160 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.787479 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.787785 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.788104 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.788424 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.788762 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.789071 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.789409 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.789735 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.790068 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.790378 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.790677 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:04:07.790917 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105709) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 02:04:07.941314 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Registered counter for database nova_api Sep 29 02:04:07.947305 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO dbcounter [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Registered counter for database nova_api Sep 29 02:04:07.961788 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:07.967582 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_db.sqlalchemy.engines [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:07.969136 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:07.974611 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writer thread running {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.025728 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.context [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07(cell1) {{(pid=105708) load_cells /opt/stack/nova/nova/context.py:464}} Sep 29 02:04:08.029809 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:04:08.030301 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:04:08.030741 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.context [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07(cell1) {{(pid=105709) load_cells /opt/stack/nova/nova/context.py:464}} Sep 29 02:04:08.031842 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:04:08.032567 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:04:08.033001 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:04:08.034670 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_concurrency.lockutils [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:04:08.035003 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:04:08.035155 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_concurrency.lockutils [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:04:08.036628 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_concurrency.lockutils [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:04:08.036994 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Registered counter for database nova_cell0 Sep 29 02:04:08.037353 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_concurrency.lockutils [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:04:08.037791 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_concurrency.lockutils [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:04:08.039916 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_concurrency.lockutils [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105709) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:04:08.040963 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Registered counter for database nova_cell1 Sep 29 02:04:08.041933 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO dbcounter [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Registered counter for database nova_cell0 Sep 29 02:04:08.046134 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO dbcounter [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Registered counter for database nova_cell1 Sep 29 02:04:08.049355 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:08.051008 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:08.053117 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_db.sqlalchemy.engines [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:08.056520 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.057743 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_db.sqlalchemy.engines [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:08.060358 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writer thread running {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.190775 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.198280 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writer thread running {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.201191 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO dbcounter [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Registered counter for database nova_cell0 Sep 29 02:04:08.208131 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO dbcounter [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Registered counter for database nova_cell0 Sep 29 02:04:08.210719 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_db.sqlalchemy.engines [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105708) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:08.215644 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writer thread running {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.217798 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG oslo_db.sqlalchemy.engines [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105709) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:04:08.222652 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writer thread running {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:04:08.551792 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:04:08.555971 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: WARNING keystonemiddleware.auth_token [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:04:08.559596 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:04:08.563282 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: WARNING keystonemiddleware.auth_token [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:04:08.902345 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:04:08.902613 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: WARNING keystonemiddleware.auth_token [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:04:08.908300 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: WARNING keystonemiddleware.auth_token [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:04:08.908434 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: WARNING keystonemiddleware.auth_token [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:04:08.913518 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558f4c5bc9c0 pid: 105709 (default app) Sep 29 02:04:08.913701 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558f4c5bc9c0 pid: 105708 (default app) Sep 29 02:04:08.915658 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:04:08.916826 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-d731b828-e490-40e4-9703-d9a2f726029c None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 29 02:04:08.917202 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Thu Sep 29 02:04:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:31.374188 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:31.376625 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003243 Sep 29 02:05:31.377198 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:31 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:31.394504 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_api:SELECT=3 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:31.395345 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_cell0:SELECT=3 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:31.396242 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_cell1:SELECT=3 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:31.397353 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:32.293637 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-dedd49b8-fe62-4e74-b493-6c4c68738314 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:32.326740 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-dedd49b8-fe62-4e74-b493-6c4c68738314 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.943085 Sep 29 02:05:32.327497 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 29 02:05:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:05:34.934296 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:34.935704 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-e285f493-6dda-434a-83e8-00d7be345f07 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001884 Sep 29 02:05:34.936363 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 2/4] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:35.374912 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-71752125-2dd8-4dee-baf2-a6f2ea27ecdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "id": "c1", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:35.425488 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-71752125-2dd8-4dee-baf2-a6f2ea27ecdd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482790 Sep 29 02:05:35.426373 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 3/5] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:05:35.441019 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:35.441858 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:35.444511 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell1:SELECT=3 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:35.445282 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:05:35.649242 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-d48297b3-bd33-408b-8ae2-ba614b01d27e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:35.725761 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-d48297b3-bd33-408b-8ae2-ba614b01d27e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290353 Sep 29 02:05:35.726675 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 3/6] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 29 02:05:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:05:38.358480 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-71752125-2dd8-4dee-baf2-a6f2ea27ecdd admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:38.359598 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-71752125-2dd8-4dee-baf2-a6f2ea27ecdd admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Sep 29 02:05:38.360228 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 4/7] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:39.066324 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b5b124e5-6573-4e25-891c-c2ce5182d954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "disk": 5}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:39.107945 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-b5b124e5-6573-4e25-891c-c2ce5182d954 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.741246 Sep 29 02:05:39.108704 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 4/8] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 29 02:05:39.120647 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a77e8e34-680e-4990-8f30-9a1345678c55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:39.164988 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a77e8e34-680e-4990-8f30-9a1345678c55 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047866 Sep 29 02:05:39.165612 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 5/9] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 29 02:05:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:05:41.777645 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-b5b124e5-6573-4e25-891c-c2ce5182d954 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:41.778697 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-b5b124e5-6573-4e25-891c-c2ce5182d954 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 29 02:05:41.779102 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:42.192251 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-865156a2-2b73-4687-acfa-1a62477bbe90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:42.213575 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-865156a2-2b73-4687-acfa-1a62477bbe90 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427820 Sep 29 02:05:42.214157 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 6/11] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:05:42.228089 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-43d125bb-72f7-4210-a502-81096b7a368f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:42.259406 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-43d125bb-72f7-4210-a502-81096b7a368f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034672 Sep 29 02:05:42.260187 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 6/12] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 29 02:05:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:05:44.871054 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-865156a2-2b73-4687-acfa-1a62477bbe90 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:44.872060 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-865156a2-2b73-4687-acfa-1a62477bbe90 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 29 02:05:44.872426 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 7/13] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:45.284425 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-08fca148-487d-4967-aece-bd6c0383618f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:45.307289 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-08fca148-487d-4967-aece-bd6c0383618f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428649 Sep 29 02:05:45.308869 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 7/14] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:05:45.329060 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a53457a3-68e8-4f7c-8f17-5e937965a535 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:45.368700 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a53457a3-68e8-4f7c-8f17-5e937965a535 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046085 Sep 29 02:05:45.373422 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 8/15] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 29 02:05:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:05:48.017343 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-08fca148-487d-4967-aece-bd6c0383618f admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:48.018411 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-08fca148-487d-4967-aece-bd6c0383618f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Sep 29 02:05:48.018887 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 8/16] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:48.443890 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a58267e2-5cf6-4ac9-86f1-ea14ceb9cc89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "disk": 20}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:48.464856 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a58267e2-5cf6-4ac9-86f1-ea14ceb9cc89 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.439646 Sep 29 02:05:48.465417 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 9/17] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:05:48.480342 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-9636d601-d74e-4551-aa7f-25f6eb1e1328 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:48.511814 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-9636d601-d74e-4551-aa7f-25f6eb1e1328 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036713 Sep 29 02:05:48.512750 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 9/18] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 29 02:05:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:05:51.216682 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a58267e2-5cf6-4ac9-86f1-ea14ceb9cc89 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:51.217655 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a58267e2-5cf6-4ac9-86f1-ea14ceb9cc89 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 29 02:05:51.218081 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 10/19] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:51.691129 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-2fd05a50-6593-4213-8144-323f7f48ba33 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:51.716868 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-2fd05a50-6593-4213-8144-323f7f48ba33 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.492274 Sep 29 02:05:51.717416 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 10/20] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 29 02:05:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:05:54.491502 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a58267e2-5cf6-4ac9-86f1-ea14ceb9cc89 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:54.492512 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a58267e2-5cf6-4ac9-86f1-ea14ceb9cc89 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 29 02:05:54.492914 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 11/21] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:54.897794 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-aff163dc-546d-4938-8205-65f015aaad41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "name": "m1.tiny", "ram": 512}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:54.919933 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-aff163dc-546d-4938-8205-65f015aaad41 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420902 Sep 29 02:05:54.920441 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 11/22] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:05:54.932762 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-0ad51fb4-d683-4474-9de7-644794e89862 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:54.964178 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-0ad51fb4-d683-4474-9de7-644794e89862 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035101 Sep 29 02:05:54.964788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 12/23] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 29 02:05:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:05:57.599778 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-aff163dc-546d-4938-8205-65f015aaad41 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:05:57.600712 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-aff163dc-546d-4938-8205-65f015aaad41 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 29 02:05:57.601136 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 12/24] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:05:57.995192 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a2568cde-1148-4185-944c-4df5c62f7b3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "id": "2", "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:58.018879 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a2568cde-1148-4185-944c-4df5c62f7b3b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411394 Sep 29 02:05:58.019658 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 13/25] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:05:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:05:58.031792 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-301a2a7c-ed18-4d35-916c-2c20da0cad2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:05:58.060149 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-301a2a7c-ed18-4d35-916c-2c20da0cad2b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032164 Sep 29 02:05:58.061680 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 13/26] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 29 02:05:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:06:00.769056 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a2568cde-1148-4185-944c-4df5c62f7b3b admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:00.769989 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a2568cde-1148-4185-944c-4df5c62f7b3b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 29 02:06:00.770427 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 14/27] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:06:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:01.219126 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-dffff8aa-76ed-48d4-bd4e-79c77cf13561 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "ram": 4096, "name": "m1.medium", "vcpus": 2}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:01.243908 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-dffff8aa-76ed-48d4-bd4e-79c77cf13561 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.466970 Sep 29 02:06:01.244460 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 14/28] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:06:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:06:01.256856 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-3493707a-6ac7-415d-a1d3-2063b24c17df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:01.286335 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-3493707a-6ac7-415d-a1d3-2063b24c17df admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033345 Sep 29 02:06:01.287093 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 15/29] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 29 02:06:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:06:03.904893 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-dffff8aa-76ed-48d4-bd4e-79c77cf13561 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:03.905913 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-dffff8aa-76ed-48d4-bd4e-79c77cf13561 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 29 02:06:03.906574 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 15/30] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:04.343132 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-3918c66d-1ee8-4812-abdc-157cabfe7394 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:04.350168 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:04.369466 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-3918c66d-1ee8-4812-abdc-157cabfe7394 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456470 Sep 29 02:06:04.370796 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 16/31] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:06:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:06:04.382265 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-5b766df5-d2ef-41a0-adcf-fd516f3a33e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:04.408915 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-5b766df5-d2ef-41a0-adcf-fd516f3a33e4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030234 Sep 29 02:06:04.409509 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 16/32] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 29 02:06:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:06:07.042493 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-3918c66d-1ee8-4812-abdc-157cabfe7394 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:07.043508 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-3918c66d-1ee8-4812-abdc-157cabfe7394 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 29 02:06:07.044094 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 17/33] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:07.476400 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c70950c5-62ba-4104-bdf2-a8a2dbb9e228 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "swap": 0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:07.483483 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:07.502768 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c70950c5-62ba-4104-bdf2-a8a2dbb9e228 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.449967 Sep 29 02:06:07.504086 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 17/34] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 29 02:06:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 29 02:06:07.516085 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-75546c4d-2438-4890-bcb3-5604a6376ec0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:07.552417 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-75546c4d-2438-4890-bcb3-5604a6376ec0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039997 Sep 29 02:06:07.553012 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 18/35] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 29 02:06:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:06:24.001002 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c70950c5-62ba-4104-bdf2-a8a2dbb9e228 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:24.002465 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c70950c5-62ba-4104-bdf2-a8a2dbb9e228 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Sep 29 02:06:24.003061 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 18/36] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:24.016449 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:06:24.454560 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-5b8cace0-c4c2-4332-8dc3-bfe8a9871efd admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:24.472777 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-5b8cace0-c4c2-4332-8dc3-bfe8a9871efd admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.463313 Sep 29 02:06:24.473315 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 29 02:06:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:06:25.786371 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c70950c5-62ba-4104-bdf2-a8a2dbb9e228 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:25.787389 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c70950c5-62ba-4104-bdf2-a8a2dbb9e228 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 29 02:06:25.787787 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 19/38] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:26.363448 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-09273eea-24c3-417b-8e8a-15bb1a116263 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:26.368859 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.wsgi [None req-09273eea-24c3-417b-8e8a-15bb1a116263 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-09273eea-24c3-417b-8e8a-15bb1a116263 admin admin] Request method failure captured: Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Accept: application/json Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Accept-Encoding: gzip, deflate Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Connection: keep-alive Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Content-Length: 0 Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Host: 10.222.0.61 Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Openstack-Api-Version: compute 2.92 Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Openstack-System-Scope: None Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: User-Agent: python-novaclient Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Auth-Token: gAAAAABjNP2hfV3VZFdKn1Kh1PmPGC91oMBA7SLrFguHfJzxhbdDy8h-lPBeMbB-95jYClLMESQuK-czWIFhWSwpCk6ctc800GLO6xWHleo1nBgJbW0wzo79Kbm-lE7ORXhlHeA5g-jXkYFks4rFGSvjURAo085wt3SVvB4o4VlyA_KqHyN8PSA Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Domain-Id: None Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Domain-Name: None Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Identity-Status: Confirmed Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Is-Admin-Project: True Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Openstack-Nova-Api-Version: 2.92 Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Domain-Id: default Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Domain-Name: Default Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Name: admin Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Role: member,reader,admin Sep 29 02:06:26.372114 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Roles: member,reader,admin Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant: admin Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant-Name: admin Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User: admin Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Domain-Id: default Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Domain-Name: Default Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Id: 4aa345955ed042db9837b36c3d6532b0 Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Name: admin Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: method: > Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: exception: Flavor 42 could not be found. Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: action_args: {'id': '42'} Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:06:26.373600 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:26.374623 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.375801 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-09273eea-24c3-417b-8e8a-15bb1a116263 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:06:26.376829 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-09273eea-24c3-417b-8e8a-15bb1a116263 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.445267 Sep 29 02:06:26.376829 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 29 02:06:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:26.383912 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-3e4c3880-ec29-4e46-b287-31e6e0a33d13 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:26.406938 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-3e4c3880-ec29-4e46-b287-31e6e0a33d13 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026636 Sep 29 02:06:26.407481 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 20/40] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 29 02:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:06:26.418542 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-7c5e715a-3bf6-4259-a88a-a9beb748b388 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:26.440523 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-7c5e715a-3bf6-4259-a88a-a9beb748b388 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026608 Sep 29 02:06:26.441177 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 21/41] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 29 02:06:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:06:26.450302 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fc1b030a-9387-46e3-8910-5fe0e3d3d8a2 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:26.455884 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-fc1b030a-9387-46e3-8910-5fe0e3d3d8a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fc1b030a-9387-46e3-8910-5fe0e3d3d8a2 admin admin] Request method failure captured: Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Host: 10.222.0.61 Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.92 Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjNP2hfV3VZFdKn1Kh1PmPGC91oMBA7SLrFguHfJzxhbdDy8h-lPBeMbB-95jYClLMESQuK-czWIFhWSwpCk6ctc800GLO6xWHleo1nBgJbW0wzo79Kbm-lE7ORXhlHeA5g-jXkYFks4rFGSvjURAo085wt3SVvB4o4VlyA_KqHyN8PSA Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.92 Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Role: member,reader,admin Sep 29 02:06:26.459267 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Roles: member,reader,admin Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User: admin Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Id: 4aa345955ed042db9837b36c3d6532b0 Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: method: > Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: exception: Flavor 42 could not be found. Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: action_args: {'id': '42'} Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:06:26.460764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:26.461710 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:26.463036 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-fc1b030a-9387-46e3-8910-5fe0e3d3d8a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:06:26.464268 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-fc1b030a-9387-46e3-8910-5fe0e3d3d8a2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013865 Sep 29 02:06:26.464268 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 29 02:06:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 29 02:06:27.701949 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-7c5e715a-3bf6-4259-a88a-a9beb748b388 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:27.703007 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-7c5e715a-3bf6-4259-a88a-a9beb748b388 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Sep 29 02:06:27.703392 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 22/43] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:28.265370 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-27691c0b-81d0-4698-9dc5-92a6a584751a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:28.273613 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-27691c0b-81d0-4698-9dc5-92a6a584751a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-27691c0b-81d0-4698-9dc5-92a6a584751a admin admin] Request method failure captured: Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Host: 10.222.0.61 Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.92 Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjNP2jupVqrcTZjhT45XDuuuh2AyMWTbNCYnhtMECOS-1UVkRiC5C2GU-nGtzzI-GZvvUTaX5pWZbwa6V2xxMvEM3INoN7zQDDVrpTU-KvLQSzbw1PbJ_0GkfcpR2lCNrae1sZWPaW6wfrjUqMAIx0BWpByZXVzAl_AMeXzp8I03mnPZI Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.92 Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Role: member,reader,admin Sep 29 02:06:28.276123 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Roles: member,reader,admin Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User: admin Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Id: 4aa345955ed042db9837b36c3d6532b0 Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: method: > Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: exception: Flavor 84 could not be found. Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: action_args: {'id': '84'} Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:06:28.277671 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:28.279666 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.280862 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-27691c0b-81d0-4698-9dc5-92a6a584751a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:06:28.281920 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-27691c0b-81d0-4698-9dc5-92a6a584751a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.439743 Sep 29 02:06:28.281920 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 29 02:06:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:28.287848 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-a338b9cd-fcd6-4e8f-ad58-6873645824bf admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:28.302893 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-a338b9cd-fcd6-4e8f-ad58-6873645824bf admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018725 Sep 29 02:06:28.303460 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 23/45] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 29 02:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:06:28.313611 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-9916d063-45eb-40fb-97a9-e2b519427290 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:28.329832 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-9916d063-45eb-40fb-97a9-e2b519427290 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020194 Sep 29 02:06:28.330397 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 29 02:06:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:06:28.340173 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-db534071-a7bb-40f7-bd04-2fbbc581972a admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:28.345307 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.wsgi [None req-db534071-a7bb-40f7-bd04-2fbbc581972a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-db534071-a7bb-40f7-bd04-2fbbc581972a admin admin] Request method failure captured: Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Accept: application/json Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Accept-Encoding: gzip, deflate Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Connection: keep-alive Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Content-Length: 0 Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Host: 10.222.0.61 Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Openstack-Api-Version: compute 2.92 Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Openstack-System-Scope: None Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: User-Agent: python-novaclient Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Auth-Token: gAAAAABjNP2jupVqrcTZjhT45XDuuuh2AyMWTbNCYnhtMECOS-1UVkRiC5C2GU-nGtzzI-GZvvUTaX5pWZbwa6V2xxMvEM3INoN7zQDDVrpTU-KvLQSzbw1PbJ_0GkfcpR2lCNrae1sZWPaW6wfrjUqMAIx0BWpByZXVzAl_AMeXzp8I03mnPZI Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Domain-Id: None Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Domain-Name: None Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Identity-Status: Confirmed Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Is-Admin-Project: True Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Openstack-Nova-Api-Version: 2.92 Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Domain-Id: default Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Domain-Name: Default Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Name: admin Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Role: member,reader,admin Sep 29 02:06:28.346864 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Roles: member,reader,admin Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant: admin Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant-Name: admin Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User: admin Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Domain-Id: default Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Domain-Name: Default Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Id: 4aa345955ed042db9837b36c3d6532b0 Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Name: admin Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: method: > Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: exception: Flavor 84 could not be found. Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: action_args: {'id': '84'} Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:06:28.348849 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:28.349817 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:28.350973 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-db534071-a7bb-40f7-bd04-2fbbc581972a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:06:28.351984 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-db534071-a7bb-40f7-bd04-2fbbc581972a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011767 Sep 29 02:06:28.351984 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 24/47] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 29 02:06:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:29.584941 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-9916d063-45eb-40fb-97a9-e2b519427290 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:29.585961 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-9916d063-45eb-40fb-97a9-e2b519427290 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 29 02:06:29.586387 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 24/48] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:30.146875 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-aa74cf20-dc87-40e0-93ee-1bed0c546cd5 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:30.153211 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.wsgi [None req-aa74cf20-dc87-40e0-93ee-1bed0c546cd5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-aa74cf20-dc87-40e0-93ee-1bed0c546cd5 admin admin] Request method failure captured: Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Accept: application/json Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Accept-Encoding: gzip, deflate Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Connection: keep-alive Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Content-Length: 0 Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Host: 10.222.0.61 Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Openstack-Api-Version: compute 2.92 Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Openstack-System-Scope: None Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: User-Agent: python-novaclient Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Auth-Token: gAAAAABjNP2loFLq9oOV8gBT3jz9PpRAduCH9njEUYNyGdcDISN3PATz1XNMWn24YxllkwhBJnlpjARg2MlJrZJe-IKYvKr5zLPPLm9rAUaVyMEBXDp-JN7jFcDtyWSATClRgU49JG6pN8Doo7xeFP73UYwQDhY0FtX50FnuHB18BGoYSQeAqGs Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Domain-Id: None Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Domain-Name: None Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Identity-Status: Confirmed Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Is-Admin-Project: True Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Openstack-Nova-Api-Version: 2.92 Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Domain-Id: default Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Domain-Name: Default Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Project-Name: admin Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Role: member,reader,admin Sep 29 02:06:30.154788 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Roles: member,reader,admin Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant: admin Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-Tenant-Name: admin Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User: admin Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Domain-Id: default Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Domain-Name: Default Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Id: 4aa345955ed042db9837b36c3d6532b0 Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: X-User-Name: admin Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: method: > Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: exception: Flavor 451 could not be found. Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: action_args: {'id': '451'} Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:06:30.156238 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:30.157049 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.158402 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-aa74cf20-dc87-40e0-93ee-1bed0c546cd5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105709) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:06:30.159602 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-aa74cf20-dc87-40e0-93ee-1bed0c546cd5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.433792 Sep 29 02:06:30.159602 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 25/49] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 29 02:06:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:30.166626 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-aded4a46-2fc0-4cd0-972b-1efded945d5a admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:30.181787 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-aded4a46-2fc0-4cd0-972b-1efded945d5a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018768 Sep 29 02:06:30.182408 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 25/50] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 29 02:06:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:06:30.192337 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:30.207424 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019120 Sep 29 02:06:30.207947 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 26/51] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 29 02:06:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:06:30.217404 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-523aaf63-c44a-4f8b-981b-d3786798f46d admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:30.222482 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.wsgi [None req-523aaf63-c44a-4f8b-981b-d3786798f46d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-523aaf63-c44a-4f8b-981b-d3786798f46d admin admin] Request method failure captured: Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Accept: application/json Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Accept-Encoding: gzip, deflate Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Connection: keep-alive Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Content-Length: 0 Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Host: 10.222.0.61 Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Openstack-Api-Version: compute 2.92 Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Openstack-System-Scope: None Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: User-Agent: python-novaclient Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Auth-Token: gAAAAABjNP2loFLq9oOV8gBT3jz9PpRAduCH9njEUYNyGdcDISN3PATz1XNMWn24YxllkwhBJnlpjARg2MlJrZJe-IKYvKr5zLPPLm9rAUaVyMEBXDp-JN7jFcDtyWSATClRgU49JG6pN8Doo7xeFP73UYwQDhY0FtX50FnuHB18BGoYSQeAqGs Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Domain-Id: None Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Domain-Name: None Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Identity-Status: Confirmed Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Is-Admin-Project: True Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Openstack-Nova-Api-Version: 2.92 Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Domain-Id: default Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Domain-Name: Default Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Project-Name: admin Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Role: member,reader,admin Sep 29 02:06:30.223974 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Roles: member,reader,admin Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c6a6000fb0914b0390fa25e08205ee14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant: admin Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant-Id: c6a6000fb0914b0390fa25e08205ee14 Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-Tenant-Name: admin Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User: admin Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Domain-Id: default Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Domain-Name: Default Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Id: 4aa345955ed042db9837b36c3d6532b0 Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: X-User-Name: admin Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: method: > Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: exception: Flavor 451 could not be found. Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: action_args: {'id': '451'} Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:06:30.225456 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:30.226475 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: ERROR nova.api.openstack.wsgi Sep 29 02:06:30.227784 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-523aaf63-c44a-4f8b-981b-d3786798f46d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105708) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:06:30.229254 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-523aaf63-c44a-4f8b-981b-d3786798f46d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011521 Sep 29 02:06:30.229485 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 26/52] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 29 02:06:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 29 02:06:31.451045 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:31.452096 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 29 02:06:31.452484 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:31.991507 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-9bf738a6-27ea-4a10-9f3d-b5b5def0dee5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:32.013580 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-9bf738a6-27ea-4a10-9f3d-b5b5def0dee5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.424428 Sep 29 02:06:32.014325 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 27/54] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 29 02:06:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:06:33.264151 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:33.265156 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 29 02:06:33.265516 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 28/55] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:33.830129 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-4c25575b-40d9-4188-8d79-09694fd7e851 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:33.852446 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-4c25575b-40d9-4188-8d79-09694fd7e851 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.451374 Sep 29 02:06:33.852999 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 28/56] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 29 02:06:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:06:35.095163 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:35.096162 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 29 02:06:35.096556 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 29/57] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:35.659988 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-2c9bdd4d-4405-47c6-9992-7cec914925a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:35.682685 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-2c9bdd4d-4405-47c6-9992-7cec914925a0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.448805 Sep 29 02:06:35.683237 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 29/58] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 29 02:06:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:06:36.936104 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:36.937099 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 29 02:06:36.937488 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 30/59] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:37.493764 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-7a2a6eee-e4a9-420b-9f72-47e881d51348 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:06:37.514865 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-7a2a6eee-e4a9-420b-9f72-47e881d51348 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.432704 Sep 29 02:06:37.515434 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 30/60] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 29 02:06:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:06:38.767906 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:38.768912 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 29 02:06:38.769301 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 31/61] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:06:39.346040 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-be848309-1022-4e7c-9a08-39c302ca6f03 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:06:39.372805 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-be848309-1022-4e7c-9a08-39c302ca6f03 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.464736 Sep 29 02:06:39.373343 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 31/62] 10.222.0.61 () {60 vars in 1202 bytes} [Thu Sep 29 02:06:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:07:36.999166 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:07:37.000663 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-52866678-1850-461d-9b42-14dd5fba7c40 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002090 Sep 29 02:07:37.001321 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 32/63] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 29 02:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:07:37.015622 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:37.424094 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-23d8613d-7b52-4c54-a378-c911ab7d6069 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:07:37.444970 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-23d8613d-7b52-4c54-a378-c911ab7d6069 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.436874 Sep 29 02:07:37.445496 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 32/64] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 29 02:07:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:07:37.467803 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_api:SELECT=14 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:07:37.473410 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-f4cd22e7-1f4a-40f3-8328-21fa25f7da5e admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:07:37.481974 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-f4cd22e7-1f4a-40f3-8328-21fa25f7da5e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016611 Sep 29 02:07:37.482607 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 33/65] 10.222.0.61 () {60 vars in 1283 bytes} [Thu Sep 29 02:07:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:07:37.494337 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-5804e173-8838-4ba4-a18e-c0b5bd4fac3b admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:07:37.501957 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-5804e173-8838-4ba4-a18e-c0b5bd4fac3b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011176 Sep 29 02:07:37.502515 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 33/66] 10.222.0.61 () {60 vars in 1286 bytes} [Thu Sep 29 02:07:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:07:37.514229 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:07:37.521826 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011212 Sep 29 02:07:37.522282 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 34/67] 10.222.0.61 () {60 vars in 1286 bytes} [Thu Sep 29 02:07:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:07:37.534279 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-657d89a6-eb21-4796-9408-3375ef7e3ff7 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:07:37.543694 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-657d89a6-eb21-4796-9408-3375ef7e3ff7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012915 Sep 29 02:07:37.544216 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 34/68] 10.222.0.61 () {60 vars in 1283 bytes} [Thu Sep 29 02:07:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:10:36.241636 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:36.242697 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 29 02:10:36.243069 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 35/69] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:10:36.382898 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=6 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:36.558173 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:36.563175 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:36.563650 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:36.564071 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:36.564770 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:36.565207 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:36.565715 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:36.597853 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-9166e681-ef8c-4bdd-aab9-f14d86db0285 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.216836 Sep 29 02:10:36.598437 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 35/70] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 29 02:10:36 2022] GET /compute/v2.1/os-services => generated 794 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:10:37.678517 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:37.679526 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 29 02:10:37.679954 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 36/71] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:10:37.870822 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:37.876004 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:37.876665 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:37.877257 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:37.878406 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:37.878949 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:37.879518 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:37.903201 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c4a41b8b-cf96-4da3-a894-fa8d6e91d293 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.084310 Sep 29 02:10:37.903717 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 36/72] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 29 02:10:37 2022] GET /compute/v2.1/os-services => generated 794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:10:49.400609 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:49.401618 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 29 02:10:49.402043 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 37/73] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:10:49.548746 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell0:SELECT=4 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:49.549667 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_cell1:SELECT=4 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:49.550643 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG dbcounter [-] [105708] Writing DB stats nova_api:SELECT=8 {{(pid=105708) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:10:49.600696 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:49.604166 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:49.604727 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:49.605082 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:49.605776 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:49.606239 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:49.606646 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:49.631681 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-c2cc1164-ed19-430e-8c6f-5227ba43c1f1 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.090389 Sep 29 02:10:49.632231 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 37/74] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 29 02:10:49 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:10:50.708186 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG nova.api.openstack.wsgi [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] Calling method '>' {{(pid=105709) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:50.709188 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: INFO nova.api.openstack.requestlog [None req-537da850-72f1-494c-b169-97dfc0a26396 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 29 02:10:50.709581 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: [pid: 105709|app: 0|req: 38/75] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 29 02:10:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:10:50.908957 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG nova.api.openstack.wsgi [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Calling method '>' {{(pid=105708) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:10:50.912352 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:50.912817 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:50.913236 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:50.913930 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:10:50.914387 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:10:50.914792 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: DEBUG oslo_concurrency.lockutils [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105708) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:10:50.937105 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: INFO nova.api.openstack.requestlog [None req-7f2b4fc7-31d4-49dd-a50e-cacf85f9d74d admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.087964 Sep 29 02:10:50.937654 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: [pid: 105708|app: 0|req: 38/76] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 29 02:10:50 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:11:48.784915 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: Thu Sep 29 02:11:48 2022 - graceful shutdown triggered... Sep 29 02:11:48.785521 dv-cinder-733062-36-iscsi devstack@n-api.service[105708]: Gracefully killing worker 1 (pid: 105708)... Sep 29 02:11:48.785930 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: Gracefully killing worker 2 (pid: 105709)... Sep 29 02:11:48.786616 dv-cinder-733062-36-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 29 02:11:48.920362 dv-cinder-733062-36-iscsi devstack@n-api.service[105709]: DEBUG dbcounter [-] [105709] Writing DB stats nova_api:SELECT=4 {{(pid=105709) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:11:49.786787 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: worker 1 buried after 1 seconds Sep 29 02:11:49.786787 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: worker 2 buried after 1 seconds Sep 29 02:11:49.786787 dv-cinder-733062-36-iscsi devstack@n-api.service[105707]: goodbye to uWSGI. Sep 29 02:11:49.789505 dv-cinder-733062-36-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 29 02:11:49.790524 dv-cinder-733062-36-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 29 02:11:49.794917 dv-cinder-733062-36-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 29 02:11:49.811912 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 29 02:11:49 2022] *** Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: nodename: dv-cinder-733062-36-iscsi Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: machine: x86_64 Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: clock source: unix Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: pcre jit disabled Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: detected number of CPU cores: 4 Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: current working directory: / Sep 29 02:11:49.815186 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: detected binary path: /usr/bin/uwsgi-core Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: your processes number limit is 47680 Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: your memory page size is 4096 bytes Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: detected max file descriptor number: 2048 Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: lock engine: pthread robust mutexes Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: thunder lock: enabled Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 29 02:11:49.816464 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 29 02:11:49.858051 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: Python main interpreter initialized at 0x561de75fa9c0 Sep 29 02:11:49.858051 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: python threads support enabled Sep 29 02:11:49.858051 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: your server socket listen backlog is limited to 100 connections Sep 29 02:11:49.858051 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: your mercy for graceful operations on workers is 90 seconds Sep 29 02:11:49.858511 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: mapped 403077 bytes (393 KB) for 2 cores Sep 29 02:11:49.858511 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: *** Operational MODE: preforking *** Sep 29 02:11:49.858813 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: *** uWSGI is running in multiple interpreter mode *** Sep 29 02:11:49.858813 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: spawned uWSGI master process (pid: 120680) Sep 29 02:11:49.859012 dv-cinder-733062-36-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 29 02:11:49.859577 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: spawned uWSGI worker 1 (pid: 120698, cores: 1) Sep 29 02:11:49.862347 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: spawned uWSGI worker 2 (pid: 120699, cores: 1) Sep 29 02:11:49.862347 dv-cinder-733062-36-iscsi devstack@n-api.service[120680]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 29 02:11:50.512846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 29 02:11:50.515365 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 29 02:11:51.657361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:11:51.657361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: from cryptography.utils import int_from_bytes Sep 29 02:11:51.658049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:11:51.658049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: from cryptography.utils import int_from_bytes Sep 29 02:11:51.715336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:11:51.715336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: from cryptography.utils import int_from_bytes Sep 29 02:11:51.715954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 29 02:11:51.715954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: from cryptography.utils import int_from_bytes Sep 29 02:11:54.072063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 02:11:54.072675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 02:11:54.072986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 02:11:54.073224 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 02:11:54.073477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 02:11:54.073873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.074233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.074553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.074875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.075209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.075536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.075883 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.076193 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.076490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.076751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.077067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.077568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-36-iscsi {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.077897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.078230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.078546 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.078913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.079212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.079502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.079833 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.080366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.081121 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.081434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.081817 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.082188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.082561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.082844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.083197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.083467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.083772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.084074 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.084584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-36-iscsi {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.085246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.085517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.085821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.086284 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.086631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.086907 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.087227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.087542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.087840 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.088158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.088477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.088813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.089118 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.089418 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.089726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.090048 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.090404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.090684 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.091012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.091249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.091559 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.091877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.092172 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.092502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.092758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.093008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.093320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.093636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.093940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.094270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.094562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.094884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.095183 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.095483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.095786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.096087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.096391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.096883 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.097058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.097382 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.098202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.098202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.098505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.098715 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.098893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.099205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.099513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.099828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.100212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.100516 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.100821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.101130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.101459 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.101788 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.102120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.102370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.102670 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.102964 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.103278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.103584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.103887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.104190 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.104489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.104820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.105092 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.105410 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.105708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.106041 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.106356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.106638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.106956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.107265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.107561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.107886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.108202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.108505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.108811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.109110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.109400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.109719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.110065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.110352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.110672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.110974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.111326 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.111594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.111912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.112212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.112524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.112825 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.113125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.113439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.113737 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.114052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.114374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.114672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.114974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.115274 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.115560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.115935 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.116230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.116549 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.116870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.117169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.117479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.117783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.118122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.118445 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.118774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.119133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.119420 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.119865 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.120069 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.120425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.120755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.120988 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.121311 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.121619 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.121931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.122275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.122584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.122906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.123232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.123545 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.123858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.124174 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.124483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.124801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.125128 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.125451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.125756 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.126120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.126470 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.126788 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.127111 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.127441 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.127751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.128063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.128374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.128721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.129034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.129343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.129660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.129974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.130320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.130631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.130945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.131248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.131592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.132070 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.132637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.132968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.133295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.133615 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.133928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.134277 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.134591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.134902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.135214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.135518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.135820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.136123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.136434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.136738 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.137065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.137391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.137701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.138045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.138358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.138669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.138978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.139290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.139592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.139904 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.140216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.140519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.140842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.141152 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.141452 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.141775 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.142106 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.142279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 29 02:11:54.142823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.142998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 29 02:11:54.143154 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.143154 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.143437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 29 02:11:54.143586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.143740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 29 02:11:54.143885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.144040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 29 02:11:54.144186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.144345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.144504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.144649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.144793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.144958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.145110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.145263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.145422 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.145567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.145724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.145869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.146058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.146225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.146371 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.146564 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.146937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.147182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.147351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.147512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.147762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.147922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.148196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.148196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.148495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-36-iscsi {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.148651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.148804 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.148957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.149101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.149253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.149410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.149568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.149712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.149862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.150037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.150216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.150454 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.150695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.150863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.151114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.151114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.151503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.151694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.151863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.152023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.152415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.152568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.152723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.152878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.153023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.153174 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.153326 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.153514 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.153680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.153840 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.153983 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.154182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.154369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.154528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.154684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.154836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.154980 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.155132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.155284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-36-iscsi {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.155437 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.155589 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.155741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.155903 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.156049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.156200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.156358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.156358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.156690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.156857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.157183 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.157350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.157512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.157659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.157885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.158099 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.158346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.158517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.158663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.158816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.158961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.159112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.159266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.159425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.159586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.159732 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.159884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.160036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.160192 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.160336 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.160576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.160817 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.160983 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.161145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.161378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.161603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.161766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.161919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.162109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.162278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.162441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.162853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.163011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.163159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.163380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.163639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.163794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.163953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.164108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.164257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.164410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.164565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.164719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.164893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.165039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.165185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.165329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.165482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.165649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.165807 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.165954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.166145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.166302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.166448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.166613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.166813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.166973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.167136 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.167498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.167655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.167822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.168063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.168220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.168383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.168844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.169006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.169172 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.169330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.169497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.169643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.169796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.169954 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.169954 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.170277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.173318 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.173519 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.173681 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.173846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.174024 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.174192 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.174348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.174517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.174683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.174840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.174986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.175139 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.175284 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.175437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.175593 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.175748 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.175895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.176039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.176190 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.176355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.176516 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.176670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.176869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.177027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.177173 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.177334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.177818 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.177985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.178644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.179022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.179187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.179335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.179504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.179659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.179813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.179966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.180126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.180317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.180480 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.180626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.180780 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.180926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.181069 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.181227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.181378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.181551 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.181705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.181858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.182022 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.182185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.182185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.182478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.182623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.182766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.182910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.183611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.183778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.183925 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.184084 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.184230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.184382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.184547 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.184702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.184856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.185011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.185165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.185319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.185474 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.185654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.185802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.185945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.186139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.186300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.186456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.186608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.186763 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.186962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.187122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.187275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.187425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.187597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.187858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.188099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.188279 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.188426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.188652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.188809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.189117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.189272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.189416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.189560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.189560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.189841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.190035 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.190201 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.190346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.190511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.190656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.190809 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.190966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.191126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.191281 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.191443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.191592 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.191745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.191891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.192043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.192195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.192354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.192520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.192667 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.192819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.192965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.193119 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.193562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.193715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.193967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.194239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.194444 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.194609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.194758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.194910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.195074 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.195228 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.195385 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.195544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.195690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.195834 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.195985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.196129 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 29 02:11:54.196273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.196510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.196671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.196817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.197033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.197033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.197338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.197492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.197638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.197790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.198215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.198372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.198537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.198769 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.198920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.199228 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.199391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.199564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.199722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.199869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200012 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200156 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.200920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201382 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.201836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.202158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.202315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.202469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.202614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.202766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.202911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.203063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.203221 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.203662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.203827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.203827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.204112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.204275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.204430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.204576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.204576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.204576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.205914 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206547 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206835 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.206988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.207182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.207338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.207483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.207639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.207791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.207951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.208198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.208444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.208602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.208765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.208986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.209144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.209461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.209629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.210156 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.210310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.210528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.210727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.210882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211035 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211795 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.211946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.212100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.212265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.212471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.212627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.212771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.212914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.213059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.213212 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.213366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.213794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.213955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.214146 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.214303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.214464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.214617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.214781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.214940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.215092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.215277 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.215440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.215601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.215760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.215920 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.216080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.216239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.216404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.216564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.216717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.216887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.217039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.217250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.217408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.217571 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.217767 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.217930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.218198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.218471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.218713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.218879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.219115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.219559 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.219742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.219905 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.220068 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.220230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.220382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.220532 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.220692 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.220857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221009 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.221656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.222179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.222334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.222496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.222660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.222813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.222963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.223114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.223264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.223438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.223940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.224119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.224279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.224440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.224592 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.224759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.224913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.225151 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.225397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.225601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.225766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.225937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.226489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.226649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.226813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.226974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.227127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.227336 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.227692 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.227853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.228014 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.228178 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.228347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.228612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.228877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.228877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.229273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.229452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.229768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.229941 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.230140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.230293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.230453 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.230612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.230776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.230929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.231080 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.231240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.231400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.231552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.231729 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.231891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.232052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.232204 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.232355 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.232514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.232757 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.232912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.233063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.233223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.233377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.233528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.233706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.234200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.234374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.234539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.234539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.234539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.234975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.235133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.235284 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.235444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.235604 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.235765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.235918 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.236089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.236250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.236402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.236555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.236719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.236872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.237030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.237181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.237375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.237533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.237693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.237852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.238041 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.238210 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.238373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.238536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.238786 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.239046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.239212 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.239455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.239612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.239612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.239612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.240208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.240370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.240524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.240709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.240950 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.241215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.241378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.241547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.241693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.241825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.242605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.242757 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.242900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.243040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.243180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.243310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.243445 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.243671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.243671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.244545 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.244699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.244816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.244929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245193 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.245891 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.246900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.247842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.248096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.248223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.248368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.248499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.248636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.248780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.249047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.249300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.249300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.249654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.249797 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250696 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.250950 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251509 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.251913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252470 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252731 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.252874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.253223 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.253343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.253471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.253613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.253750 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.253887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.254047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.254568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.254703 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.254852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.254852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.255343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.255472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.255609 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.255740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.255740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.256001 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.256137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.256137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.256697 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.256882 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257026 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257756 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.257936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.258908 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.259912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260674 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260757 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.260935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261116 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.261830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262519 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262604 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.262868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.263798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264796 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.264979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265702 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.265973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266161 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266446 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266531 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.266994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267548 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267641 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.267996 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268545 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.268912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269008 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269635 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269736 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.269966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270085 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270500 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.270941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271305 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271848 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.271971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272062 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.272879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273512 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.273913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274716 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.274869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275280 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.275884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.276099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.276192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.276406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.276499 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.276715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.276814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.277969 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.278158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.278299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.278387 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.278644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.278777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.278965 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.279140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.279328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.279511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.279641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.279825 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.279972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.280135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.280294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.280458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.280624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.280780 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.280937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.281096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.281255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.281412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.281562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.281730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.281879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.282197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.282377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.282471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.282686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.282793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.282994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.283094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.283299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.283398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.283627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.283719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.284074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.284389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.284720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.285047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.285233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.285404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.285667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.285821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.285971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.286208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.286303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.286423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.286606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.286763 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.286922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.287102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.287236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.287431 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.287719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.288222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.288478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.288585 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.288791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.288894 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.289115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.289216 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.289445 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.289539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.289772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.289865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.290119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.290256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.290440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.290569 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.290776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.290896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.291348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.291461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.291607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.291699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.291793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.291886 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.292083 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.292216 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.292415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.292630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.292750 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.292998 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.293173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.293323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.293498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.293659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.293824 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.293994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.294167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.294340 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.294489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.294659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.294814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.294988 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.295215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.295376 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.295524 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.295664 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.295803 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.295950 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.296167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.296324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.296494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.296657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.296795 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297090 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297824 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.297973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.298967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.299061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.299285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.299385 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.299594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.299687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.299914 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300224 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300331 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300839 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.300989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.301265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.301440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.301582 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.301735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.301885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.302128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.302336 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.302488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.302649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.302817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.302965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.303103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.303341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.303745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.303844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.304302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.304425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.304748 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.304888 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.305090 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.305221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.305477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.305591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.305908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.306051 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.306381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.306513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.306798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.306920 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.307248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.307366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.307686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.307811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.308094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.308213 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.308537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.308649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.309012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.309135 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.309577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.309791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.310122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.310245 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.310463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.310676 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.310938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.311172 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.311384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.311515 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.311683 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.311828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.311973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.312114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.312253 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.312448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.312630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.312830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.312972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.313170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.313314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.313512 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.313723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.313864 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.314048 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.314200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.314378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.314534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.314711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.314940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.315058 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.315269 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.315378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.315631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.315782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.315966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.316115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.316263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.316403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.316582 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.316732 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.316899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317048 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.317972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.318179 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.318293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.318496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.318589 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.318882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.318977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.319239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.319478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.319625 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.319760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.319974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.320097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.320290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.320442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.320603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.320784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.320916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.321106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.321237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.321456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.321611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.321800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.321943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.322160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.322272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.322483 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.322620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.322814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.322936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.323152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.323301 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.323467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.323571 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.323781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.323874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.324102 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.324198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.324419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.324521 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.324735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.324828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325155 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325683 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.325994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.326129 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.326330 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.326424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.326665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.326767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.326978 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.327073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.327293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.327386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.327601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.327707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.327914 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328009 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328540 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328845 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.328938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.329149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.329249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.329463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.329564 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.329766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.329858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.330096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.330191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.330402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.330505 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.330708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.330801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331019 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331416 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331759 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.331930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.332038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.332234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.332337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.332538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.332641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.332973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.333116 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.333304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.333428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.333632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.333738 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.334081 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.334249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.334526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.334629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.335265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.335368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.335591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.335694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.335897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.335990 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.336220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.336322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.336538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.336639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.336860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.336952 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.337173 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.337264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.337492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.337605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.337804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.337896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.338153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.338308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.338482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.338577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.338807 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.338908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.339122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.339215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.339460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.339554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.339773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.339874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.340086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.340179 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.340400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.340535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.340713 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.340814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.341026 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.341133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.341337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.341430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.341670 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.341791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.342012 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.342123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.342351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.342451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.342679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.342780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343740 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.343951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.344046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.344268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.344366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.344582 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.344675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.344898 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.345951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.346183 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.346297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.346494 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.346603 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.346804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.346897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.347122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.347333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.347444 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.347658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.347771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.348989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.349081 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.349317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.349423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.349650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.349741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.349961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.350111 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.350398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.350511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.350780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.350872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.351101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.351200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.351416 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.351516 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.351688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 02:11:54.351825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.352110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.352367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.352691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.353006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.353557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.353920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.354275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.354612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.354947 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.355273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.355589 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.355927 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.356240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.356555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.356880 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.357201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.357512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.357830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.358182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.358501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.358813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.359130 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.359439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.359772 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.360087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.360399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.360708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.361024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.361380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.361644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.361957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.362289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.362610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.362917 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.363329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.363644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.363961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.364331 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.364652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.364964 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.365294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.365606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.365946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.366295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.366615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.366948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.367268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.367586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.367949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.368276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.368829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.369172 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.369505 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.369847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.370211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.370529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.370840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.371153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.371488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.371806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.372194 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.372449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.372763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.373080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.373401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.373742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.374050 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.374370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.374685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.375004 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.375320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.375638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.375954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.376279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.376625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.376955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.377283 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.377609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.377938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.378279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.378598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.378913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.379229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.379552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.379890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.380211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.380525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.380960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.381300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.381694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.382133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.382454 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.382791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.383123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.383445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.383790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.384094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.384432 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.384782 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.385118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.385454 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.385766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.386103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.386421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.386736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.387064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.387381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.387693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.388008 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.388324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.388635 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.388946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.389253 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.389563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.389879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.390220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.390532 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.390841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.391149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.391456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.391765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.392080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.392389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.392701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.393008 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.393315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.393620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.393960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.394324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.394649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.394978 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.395298 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.395624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.395940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.396270 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.396603 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.396954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.397381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.397726 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.398075 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.398397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.398720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.399039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.399356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.399675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.400011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.400347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.400658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.400994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.401320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.401649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.401974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.402315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.402654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.402973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.403289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.403606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.403923 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.404241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.404562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.404877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.405196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.405553 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.405871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.406226 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.406531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.406847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.407176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.407508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.407866 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.408185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.408534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.408868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.409189 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.409506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.409819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 29 02:11:54.410090 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 29 02:11:54.412502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO dbcounter [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Registered counter for database nova_api Sep 29 02:11:54.433072 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_db.sqlalchemy.engines [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.440125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writer thread running {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.471902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Registered counter for database nova_api Sep 29 02:11:54.492551 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.496623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.context [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07(cell1) {{(pid=120699) load_cells /opt/stack/nova/nova/context.py:464}} Sep 29 02:11:54.499766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.500634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:11:54.501101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:11:54.502717 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:11:54.503563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:11:54.504012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:11:54.506019 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:11:54.508095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO dbcounter [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Registered counter for database nova_cell0 Sep 29 02:11:54.512132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO dbcounter [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Registered counter for database nova_cell1 Sep 29 02:11:54.519327 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_db.sqlalchemy.engines [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.521707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_db.sqlalchemy.engines [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.527771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writer thread running {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.556678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.context [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07(cell1) {{(pid=120698) load_cells /opt/stack/nova/nova/context.py:464}} Sep 29 02:11:54.560766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:11:54.561245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:11:54.562886 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:11:54.563657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:11:54.564103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:11:54.566137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:11:54.568173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Registered counter for database nova_cell0 Sep 29 02:11:54.572269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Registered counter for database nova_cell1 Sep 29 02:11:54.580397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.581613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.588852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.590156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.666865 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writer thread running {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.677602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO dbcounter [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Registered counter for database nova_cell0 Sep 29 02:11:54.685113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_db.sqlalchemy.engines [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.689976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writer thread running {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:54.736168 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO dbcounter [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Registered counter for database nova_cell0 Sep 29 02:11:54.745579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_db.sqlalchemy.engines [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 29 02:11:54.751000 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writer thread running {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 29 02:11:55.012294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: WARNING keystonemiddleware.auth_token [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:11:55.019699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: WARNING keystonemiddleware.auth_token [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:11:55.065760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:11:55.073933 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:11:55.370617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: WARNING keystonemiddleware.auth_token [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:11:55.379131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: WARNING keystonemiddleware.auth_token [None req-00e496e8-d24c-40f0-bbbe-49f6e3b1dc55 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:11:55.384834 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561de75fa9c0 pid: 120699 (default app) Sep 29 02:11:55.422218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 29 02:11:55.428378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: WARNING keystonemiddleware.auth_token [None req-4dbc766d-b6d7-45f2-b619-f6292799392e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 29 02:11:55.433749 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561de75fa9c0 pid: 120698 (default app) Sep 29 02:12:43.195063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.196700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.197704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.198445 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:43.849101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-bb779419-bc68-4d58-870f-2d7bd2111af6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: .version_select at 0x7f404e9654c0>, body: {"keypair": {"name": "tempest-keypair-1679844879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUxTJ9cYXJLhull3GaNF3vAVc8iyn6PAmWn42R+lkEMIF1qSgQQ0FihBwLYZbTU48aCyRAy1i92iiKiXzFE+vdlx/S9h4hsZmzaxtFzz/qKyRHzfIv0n/vzWyvtkKo2DA=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:43.956528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-bb779419-bc68-4d58-870f-2d7bd2111af6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:43.978285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-bb779419-bc68-4d58-870f-2d7bd2111af6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:44.079220 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-bb779419-bc68-4d58-870f-2d7bd2111af6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.908997 Sep 29 02:12:44.084823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:12:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:12:46.176653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.177691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.181022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.182404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:12:46.542276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0432f20f-a517-4371-acff-590187f9d39a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: .version_select at 0x7f404e831670>, body: {"keypair": {"name": "tempest-keypair-1378693663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9XdjpsSKNXdUAPsH2ew9z3LCsBEirlr5uUKwsIPsx7OIcBoQ7edtOGzbWyiU96uU6qUJSzaeV1zyXMUoaKfMsFlyWeQXKVkJhwyvmsDfnU5YBfKl7N1pyZ/AbQLiO45Q=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:46.575275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-0432f20f-a517-4371-acff-590187f9d39a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:46.587748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-0432f20f-a517-4371-acff-590187f9d39a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for user 480c3f60b5e14b5f93e5dc921694aee4 and project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:46.656683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0432f20f-a517-4371-acff-590187f9d39a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.273611 Sep 29 02:12:46.660928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:12:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:12:46.988745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-828716417", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "networks": [{"uuid": "e4db59af-b58e-48e5-9867-6d81c2594bb7"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:47.086660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1887292219", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21696cbf-ef5b-4f26-afb0-c5d58c71da44"}], "security_groups": [{"name": "tempest-securitygroup--1688817800"}], "key_name": "tempest-keypair-1679844879", "user_data": "}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:47.615036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] validate_networks() for [('e4db59af-b58e-48e5-9867-6d81c2594bb7', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:12:47.899315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] validate_networks() for [('21696cbf-ef5b-4f26-afb0-c5d58c71da44', None, None, None, None, None)] {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:12:50.128936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:12:50.129517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:12:50.129985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:12:50.130428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:12:50.130890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:12:50.177709 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:50.179524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:50.180003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:50.181164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:50.183636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:50.187257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:50.262858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:50.273711 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:50.312049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Going to run 1 instances... {{(pid=120699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:12:50.318693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:12:50.520404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7ede21e8-ae4c-4bb9-8337-f346be9e8101 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.445719 Sep 29 02:12:50.521501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 3/3] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:12:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 3451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:12:50.534975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1df8ab91-f4c5-4c96-9128-9ae5cb198ddc tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:50.537322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1df8ab91-f4c5-4c96-9128-9ae5cb198ddc tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:50.630280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:12:50.630751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:12:50.631236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:12:50.631652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:12:50.632065 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:12:50.686086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:50.686859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:50.687653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:50.689182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:50.691170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:50.691893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:50.777623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Getting quotas for project 45259b9967b9410ca0fb09df7cea9f15. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:50.797022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Getting quotas for user 3b624208bb94427791219ffcca0efc41 and project 45259b9967b9410ca0fb09df7cea9f15. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:50.845791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:12:50.858695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:12:51.153068 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3159308-a29b-4d12-a3e1-6358de9d106a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.983783 Sep 29 02:12:51.154185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 1/4] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 4986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:12:51.171673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0ee30ad5-e93e-4f65-893f-c8cdc9a47bff tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:51.172555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0ee30ad5-e93e-4f65-893f-c8cdc9a47bff tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:51.295646 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1df8ab91-f4c5-4c96-9128-9ae5cb198ddc tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:51.373971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1df8ab91-f4c5-4c96-9128-9ae5cb198ddc tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1242 microversion: 2.1 time: 0.844225 Sep 29 02:12:51.385358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 4/5] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:50 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1242 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:51.754880 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0ee30ad5-e93e-4f65-893f-c8cdc9a47bff tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:51.791390 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0ee30ad5-e93e-4f65-893f-c8cdc9a47bff tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1214 microversion: 2.1 time: 0.625779 Sep 29 02:12:51.794617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 2/6] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:51 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1214 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:52.410703 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a4c87973-d04c-407f-928b-cbe2a345545a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:52.412328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a4c87973-d04c-407f-928b-cbe2a345545a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:52.820311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-830c4467-d65e-497b-bb60-ce0e7f9204ac tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:52.822113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-830c4467-d65e-497b-bb60-ce0e7f9204ac tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:53.117986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a4c87973-d04c-407f-928b-cbe2a345545a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:53.131395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a4c87973-d04c-407f-928b-cbe2a345545a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1242 microversion: 2.1 time: 0.722230 Sep 29 02:12:53.133813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 5/7] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:52 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1242 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:53.146853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-830c4467-d65e-497b-bb60-ce0e7f9204ac tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:53.160207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-830c4467-d65e-497b-bb60-ce0e7f9204ac tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1214 microversion: 2.1 time: 0.343002 Sep 29 02:12:53.164861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 3/8] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:52 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1214 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:12:53.959011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2101624697", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:54.162768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] validate_networks() for [('39e5f739-8a9f-418d-a753-3adeb7a47d7a', None, None, None, None, None)] {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:12:54.312034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37f635c0-74ee-4dcd-82cb-4675c0a67ffa tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'create', calling method: .version_select at 0x7f404df35280>, body: {"keypair": {"name": "tempest-keypair-920671925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS7cIgJyrVev9pxB13yutgd5+aMNSJuz2Y2Ses/kEnLUyNWJsC68EiqIz+q1TNRcbDW1eHYrmMJkIzSLEzdyWhIlX7CjumoAb9lOIFn285UZAYmjfJR18ajpUHuCiZtcA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:54.390968 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-37f635c0-74ee-4dcd-82cb-4675c0a67ffa tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for project ad99e285720d41988cf2cf8f8978c313. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:54.398879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-37f635c0-74ee-4dcd-82cb-4675c0a67ffa tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for user d0ed4854e0d449e58d09487fe8eedc2c and project ad99e285720d41988cf2cf8f8978c313. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:54.472611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37f635c0-74ee-4dcd-82cb-4675c0a67ffa tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.430183 Sep 29 02:12:54.473443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 4/9] 10.222.0.61 () {62 vars in 1200 bytes} [Thu Sep 29 02:12:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 29 02:12:54.489398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:54.490449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:54.507025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:54.509499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:54.510264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:54.511709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:54.513616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:54.514748 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:54.779853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:54.810693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9e1e7f5-1dcc-4209-9d65-35f72d44e848 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1238 microversion: 2.1 time: 0.335560 Sep 29 02:12:54.813989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 5/10] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:54 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1238 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:54.820477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:54.821316 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:54.832160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:54.832953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:54.833784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:54.835320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:54.837625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:54.838725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:54.988985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:55.007117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31614481-fe70-4f76-a91b-264486f8e005 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1266 microversion: 2.1 time: 0.189360 Sep 29 02:12:55.024093 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:54 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:55.037555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1697279914", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "106d8127-c1ae-4a0b-8b5c-0698e340d643"}], "security_groups": [{"name": "tempest-securitygroup--63102901"}], "key_name": "tempest-keypair-1378693663", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:55.247951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] validate_networks() for [('106d8127-c1ae-4a0b-8b5c-0698e340d643', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:12:55.287751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Flavor limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:12:55.288293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Image limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:12:55.289359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Flavor pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:12:55.290383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Image pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:12:55.292306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:12:55.342548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:55.342820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:55.349964 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:55.352938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:55.354953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:55.357000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:55.444785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for project 8f88658c804e40229386a559fd2a1fa9. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:55.450873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for user 0df60784a8b3468ca19ec2cee1d929e5 and project 8f88658c804e40229386a559fd2a1fa9. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:55.467180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Going to run 1 instances... {{(pid=120699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:12:55.469979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:12:55.566088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b1eba202-8dc5-48ba-a16a-d68df6e52c4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.017670 Sep 29 02:12:55.567395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 6/12] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:12:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:12:55.581129 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a2605b78-5247-44d6-9b00-4a3e8618b265 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:55.581746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a2605b78-5247-44d6-9b00-4a3e8618b265 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:56.550940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a2605b78-5247-44d6-9b00-4a3e8618b265 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:56.566316 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a2605b78-5247-44d6-9b00-4a3e8618b265 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1222 microversion: 2.1 time: 0.989042 Sep 29 02:12:56.570658 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:55 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1222 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:56.581887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:56.585948 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:56.631025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:56.631613 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:56.645179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:56.652487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:56.654956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:56.657054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:56.668988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:12:56.670721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:12:56.671503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:12:56.672133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:12:56.672741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:12:56.687502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:56.688910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:56.693392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:56.694545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:56.695233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:56.695869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:56.747816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:12:56.755144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for user 480c3f60b5e14b5f93e5dc921694aee4 and project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:12:56.788238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:12:56.792243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:12:56.956859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4549ea4-ca7d-44e8-8a5a-e9704e0d3fd5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.931416 Sep 29 02:12:56.958779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 7/14] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:12:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 1934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:12:56.980219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:56.981224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:57.001156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:57.002071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:57.002768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:57.005740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:57.008626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:57.009419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:57.383548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:57.402456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:57.421247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8498500c-f49d-42f3-83f5-bb2fa3ea633a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1300 microversion: 2.1 time: 0.842103 Sep 29 02:12:57.425094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:56 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1300 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:57.428701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-944b52a5-f1ae-47d7-912f-9db237fd333b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1272 microversion: 2.1 time: 0.460003 Sep 29 02:12:57.447721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:56 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1272 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:57.454174 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-378252775", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:12:57.487607 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2167b15-d230-4cf0-ac5c-5d30e143c4b6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:57.493881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2167b15-d230-4cf0-ac5c-5d30e143c4b6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:57.687769 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] validate_networks() for [('39e5f739-8a9f-418d-a753-3adeb7a47d7a', None, None, None, None, None)] {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:12:57.745891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2167b15-d230-4cf0-ac5c-5d30e143c4b6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:57.777034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2167b15-d230-4cf0-ac5c-5d30e143c4b6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1238 microversion: 2.1 time: 0.311140 Sep 29 02:12:57.802527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 9/17] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:57 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1238 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:58.450479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:58.451248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:58.480558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:58.484362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:58.484798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:58.498229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:58.498904 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:58.499352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:59.203629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:59.236751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-252ef113-126e-4808-b37c-8d0aba3a8cfa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1300 microversion: 2.1 time: 0.777864 Sep 29 02:12:59.237754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 10/18] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:58 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1300 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:59.247025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:59.255426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:59.300494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:59.301002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:59.303952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:59.303952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:59.303952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:59.303952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:59.565173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:12:59.575462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb0e90fc-6220-4912-8a06-2ef48b9629f7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1272 microversion: 2.1 time: 0.336375 Sep 29 02:12:59.578042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 11/19] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:59 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:12:59.591760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:12:59.592640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:12:59.604827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:59.608306 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:59.619373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:12:59.623032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:12:59.624503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:12:59.626588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:00.651884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:00.666586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e2a9b1b8-f8f9-48fa-bbd1-b54ed5b8afb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1290 microversion: 2.1 time: 1.084725 Sep 29 02:13:00.678034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 12/20] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:12:59 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1290 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:00.702421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:00.718753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:00.761503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:00.763370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:00.765200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:00.770420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:00.772601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:00.774998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:02.001119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Flavor limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:13:02.001719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Image limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:13:02.002126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Flavor pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:13:02.002616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Image pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:13:02.003107 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:13:02.036421 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:02.036900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:02.037346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:02.038109 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:02.038575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:02.039006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:02.123972 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for project 8f88658c804e40229386a559fd2a1fa9. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:13:02.150542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for user 0df60784a8b3468ca19ec2cee1d929e5 and project 8f88658c804e40229386a559fd2a1fa9. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:13:02.197891 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Going to run 1 instances... {{(pid=120699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:13:02.214100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:13:02.416094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e60b9b76-608a-4bf1-94ac-e8b28bda7e49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.987752 Sep 29 02:13:02.418171 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 9/21] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:12:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 4992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:13:02.428138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:02.430465 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:02.487678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:02.488903 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:02.491472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:02.492723 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:02.496591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:02.500901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:03.262038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:03.275911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9a2fd0e-0399-43e6-b68e-2007c29ba69d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 2.593208 Sep 29 02:13:03.279095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 13/22] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:00 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 2598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:03.293554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:03.294607 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:03.310291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:03.311512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:03.320892 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:03.321935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:03.324017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:03.324667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:03.590791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:03.618762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-766d979b-4314-48ac-9ae4-8517a772cd19 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1296 microversion: 2.1 time: 0.337464 Sep 29 02:13:03.619502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 14/23] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:03 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1296 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:03.644738 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bf2b19ff-9848-4bd6-95b7-45d042fac136 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:03.645457 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bf2b19ff-9848-4bd6-95b7-45d042fac136 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:03.893387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bf2b19ff-9848-4bd6-95b7-45d042fac136 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:03.913489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bf2b19ff-9848-4bd6-95b7-45d042fac136 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1221 microversion: 2.1 time: 0.277697 Sep 29 02:13:03.919822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 15/24] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:03 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1221 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:03.940502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-661388700", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "712ee1de-b49d-47dd-8bc6-ac6e7ab6bb1a"}], "security_groups": [{"name": "tempest-securitygroup--1987195581"}], "key_name": "tempest-keypair-920671925", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:04.443961 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:04.470884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2e59e195-89b2-4b40-9fdc-cc7abbab117f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 2.048291 Sep 29 02:13:04.473737 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 10/25] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:02 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:04.490550 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:04.495851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:04.522249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:04.523287 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:04.523960 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:04.539292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:04.541806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:04.553768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:05.544896 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:05.556969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e172f4ad-6c7e-4f99-b7fa-d82e3c923842 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 1.081625 Sep 29 02:13:05.560759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 11/26] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:04 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:05.568513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:05.575924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:05.598479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:05.605278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:05.607179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:05.610300 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:05.613921 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:05.617303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:05.882622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:05.918477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-664d27ff-c17d-4cdc-97ec-ccd1399a315a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1296 microversion: 2.1 time: 0.352323 Sep 29 02:13:05.921230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 12/27] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:05 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1296 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:05.948686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:05.950650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:05.967222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:05.968015 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:05.969830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:05.970803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:05.985755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:05.986249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:06.288669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] validate_networks() for [('712ee1de-b49d-47dd-8bc6-ac6e7ab6bb1a', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:13:06.706612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:06.814530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:06.836084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a908760b-2255-4660-a704-aea9ebaecb2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1273 microversion: 2.1 time: 0.904063 Sep 29 02:13:06.840368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 13/28] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:05 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1273 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:06.853684 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:06.855245 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:06.877847 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:06.889689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:06.890436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:06.891568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:06.892181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:06.893099 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:07.777049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:07.792299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ffb1f28b-7e73-4fb0-b51c-7b0637755a47 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.945600 Sep 29 02:13:07.806797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 14/29] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:06 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:07.830567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:07.831231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:07.835975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:07.854347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:07.855455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:07.856836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:07.858893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:07.862622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:07.863910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:09.059723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:13:09.061352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:13:09.062450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:13:09.063365 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:13:09.064341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:13:09.094675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:09.096220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:09.099355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:09.100639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:09.105125 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:09.108231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:09.175824 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for project ad99e285720d41988cf2cf8f8978c313. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:13:09.196210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for user d0ed4854e0d449e58d09487fe8eedc2c and project ad99e285720d41988cf2cf8f8978c313. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:13:09.237148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:13:09.239828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:13:09.414328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e36f1661-fbc6-4113-9a61-7be7cefa0ad6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.492955 Sep 29 02:13:09.415263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 16/30] 10.222.0.61 () {62 vars in 1188 bytes} [Thu Sep 29 02:13:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 5495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 29 02:13:09.443012 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:09.448400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:09.486789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:09.495513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:09.497623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:09.500920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:09.504573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:09.505277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:10.004493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:10.031017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-de879629-15f4-46db-bbae-3eca36a61443 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 2.222979 Sep 29 02:13:10.031609 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 15/31] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:07 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:10.050545 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:10.051487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:10.112402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:10.114987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:10.115465 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:10.116220 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:10.116673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:10.117117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:10.654461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:10.667262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-add1e05e-8012-44a9-8236-389218689b04 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.633425 Sep 29 02:13:10.667919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 16/32] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:10 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:10.679974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:10.682211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:10.695052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:10.695797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:10.696251 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:10.700276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:10.700790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:10.701287 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:10.784802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:10.794021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a061aa2c-a65c-4ad9-aea3-97568c19479f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 1.365078 Sep 29 02:13:10.808507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 17/33] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:09 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:11.113956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:11.130073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-356d188e-6c39-48fc-b4a3-e1e7a1cc791d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.454452 Sep 29 02:13:11.131158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 17/34] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:10 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:11.173555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d6d291-847b-4e09-b49e-4c5ec0dfae6c", "tag": "d183c6c3-e338-4c72-a436-81e93d6fc258"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:11.192512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:11.199110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.200033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.200647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.231594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Creating event network-changed:d183c6c3-e338-4c72-a436-81e93d6fc258 for instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c on hv-cinder-73306 Sep 29 02:13:11.232388 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 29 02:13:11.232913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-022cb540-c9d8-4dd5-99b5-f92e189959e8 req-b78dfd20-ee53-4d63-9d1e-0335a88b7bdc service nova] Acquired lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 29 02:13:11.234311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.234906 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.235742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.237257 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.238031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.238615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.251318 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.compute.rpcapi [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 29 02:13:11.252568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120698) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 29 02:13:11.256402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9884b6fc-bf84-48e8-8f73-b80408c9b348", "tag": "62cb9340-38dd-43f9-a051-285ad5137842"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:11.274562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d083d21-e0c8-4e22-882d-c0724e5687d2 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464014 Sep 29 02:13:11.275600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 18/35] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:11.281684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:11.282632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:11.284279 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.285108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.286778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.316784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.316784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.316784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.317905 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Creating event network-changed:62cb9340-38dd-43f9-a051-285ad5137842 for instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 on hv-cinder-73306 Sep 29 02:13:11.318647 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 29 02:13:11.319717 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-84faebee-fec1-4309-a71b-b65489c88129 req-f4b77a27-058f-43b1-abeb-abdca9666a6b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 29 02:13:11.320958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.321438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.321867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.322291 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.322963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.323551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.324856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.325977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.326654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.346221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.compute.rpcapi [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 29 02:13:11.347897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] Releasing lock "compute-rpcapi-router" {{(pid=120699) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 29 02:13:11.375471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-77a7eec7-7a3c-44ce-bae4-134b77e442d0 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242902 Sep 29 02:13:11.376375 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 18/36] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:11.392210 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:11.393097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:11.403481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.405198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.405783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.406667 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.407284 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.407858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.561125 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:11.573345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:11.577655 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:11.578839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a8202ea-954c-4c95-b435-ab74da19876d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1284 microversion: 2.20 time: 0.301753 Sep 29 02:13:11.590593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:11 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1284 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:11.694586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:11.695216 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:11.707576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.708071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.708529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.709216 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.709668 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.710116 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.774362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:11.790981 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-581d2af9-1377-45a5-a890-817a52e0cad1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.410450 Sep 29 02:13:11.791972 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 19/38] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:11 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:11.822648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:11.823301 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:11.837275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.838263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.839121 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:11.840423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:11.841036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:11.841611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.063334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:12.073415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-855bba69-1383-4c36-807d-26fb3569516b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.382386 Sep 29 02:13:12.086836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 20/39] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:11 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:12.154269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:12.155300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:12.165327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:12.168483 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:12.170462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.172609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:12.176813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:12.177344 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=32 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:12.178826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.346743 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:12.360216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-91ff66e8-e7b1-4f35-bd16-6ef3f5cc8f20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.547207 Sep 29 02:13:12.388808 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 20/40] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:11 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:12.490847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:12.506754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-274a483f-8b7f-4ebe-b427-a5af9c47d1e8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.357336 Sep 29 02:13:12.507888 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 21/41] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:12 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:12.606529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:12.607143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:12.623974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:12.624465 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:12.631091 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.632440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:12.633105 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:12.633871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.821262 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:12.821876 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:12.832924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:12.843911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:12.845294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:12.846193 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:12.846838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:12.847279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.855231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:12.856006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:12.856881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:12.859748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ec191a21-3b6f-466a-b2b0-65ee621b120c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1284 microversion: 2.20 time: 0.257406 Sep 29 02:13:12.861146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:12 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:13.099704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:13.101009 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:13.120263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.123303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.124030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.124994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.126682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.127348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.162511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.172700 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1e8078b4-46db-4af5-ad09-2ecf1acdb62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.360595 Sep 29 02:13:13.173284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 22/43] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:12 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:13.297466 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bcb7821-6480-46f9-a220-78d1214f7181", "tag": "8d6a66c4-84ec-4b80-817a-4a5dfdc81a64"}, {"name": "network-changed", "server_uuid": "122ad38e-8b7c-440d-99ab-e3c7063691ad", "tag": "870d1dee-af78-44b4-8d9b-36d459c3e5c4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:13.325529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.326125 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.326571 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.364874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] Creating event network-changed:8d6a66c4-84ec-4b80-817a-4a5dfdc81a64 for instance 1bcb7821-6480-46f9-a220-78d1214f7181 on hv-cinder-73306 Sep 29 02:13:13.365717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] Creating event network-changed:870d1dee-af78-44b4-8d9b-36d459c3e5c4 for instance 122ad38e-8b7c-440d-99ab-e3c7063691ad on hv-cinder-73306 Sep 29 02:13:13.371791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.377224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-aafe7283-a6f7-4e3f-b5a0-f6367d5c2e9f req-8640a145-9804-4ec4-8cbc-0b190f4d6c93 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083459 Sep 29 02:13:13.378528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=87 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:13.379315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 23/44] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:13.384138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3416be23-b1eb-47c8-81b6-1b0e04028918 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.290840 Sep 29 02:13:13.386029 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 22/45] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:13 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:13.395218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:13.398362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:13.411996 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.412752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.413348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.416353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.419472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.419914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.539787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:13.540436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:13.561641 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.562221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.562669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.570329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.571034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.571855 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.652663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.662364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01d1cfc4-ea96-4181-8000-766dbe2cdc02 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.271965 Sep 29 02:13:13.662945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 24/46] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:13 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:13.821136 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.833060 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fe03eba2-14c3-4f5a-93fd-ad3e6c0d79e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.297091 Sep 29 02:13:13.833612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 23/47] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:13 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:13.891510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:13.892156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:13.898969 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.899430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.900192 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.901181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:13.904743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:13.904743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:13.922284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:13.968990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.978803 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.981061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:13.982425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9819ccb3-f55a-4f08-a745-8800345f24b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1284 microversion: 2.20 time: 0.095142 Sep 29 02:13:13.983006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 25/48] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:13 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:14.196911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:14.198097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:14.204891 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.205415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.205846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.206972 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.207581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.208011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.369866 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:14.378999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-727ebf55-266b-4880-93c0-5d93de00ac8f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.186434 Sep 29 02:13:14.382150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 24/49] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:14 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:14.409753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:14.410408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:14.417878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.418411 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.419044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.419747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.420199 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.420619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.561409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:14.569074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ded9dfd-8b27-40ae-9f64-7a5fb62641f2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.163955 Sep 29 02:13:14.569816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 26/50] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:14 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:14.691548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:14.692162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:14.698240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.698798 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.699168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.699821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.700436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.701003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.859223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:14.860063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:14.868150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.868645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.869083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.870036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:14.870696 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:14.871137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:14.886030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:14.893716 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1516129a-5eac-4add-b528-e320cc3a3fca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.205875 Sep 29 02:13:14.894584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 25/51] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:14 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:15.007323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:15.008129 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:15.015067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.015631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.016181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.017192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.017648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.018123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.019088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:15.027844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a660fb26-774b-4ea0-9634-11bb4dd76369 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.174827 Sep 29 02:13:15.028609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 27/52] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:14 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:15.092108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:15.100823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:15.102432 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:15.103743 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e0b512be-2ec5-4245-8f21-1155af2dacb1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1284 microversion: 2.20 time: 0.100396 Sep 29 02:13:15.104932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 26/53] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:15 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:15.402952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:15.403542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:15.410245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.410839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.411516 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.411803 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.412245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.412661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.556027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:15.565256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4741c873-dca8-43d8-a265-9df965378e0f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.166569 Sep 29 02:13:15.565927 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 28/54] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:15 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:15.592389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:15.593004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:15.599184 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.599671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.600114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.600991 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.601471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.601886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.896191 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:15.913554 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9020ef61-3439-4d32-b2f3-62d66fc3f372 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.325092 Sep 29 02:13:15.925332 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:15.926266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:15.927490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 27/55] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:15 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:15.938455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.939715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.940418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:15.941442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:15.942198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:15.942773 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.057670 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:16.058291 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:16.069455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.069944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.080872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.081656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.082174 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.082598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.135977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:16.145525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcb67dd0-46a8-4b66-add2-a3a427ca1096 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.225967 Sep 29 02:13:16.146257 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 29/56] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:15 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:16.154101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:16.155594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:16.162566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.163392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.164279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.165357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.165991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.166730 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.249633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:16.260487 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:16.262239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:16.264443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f5e9d9e-d539-4c5d-a834-bf70ab97cba6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1276 microversion: 2.20 time: 0.115393 Sep 29 02:13:16.282111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 30/57] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:16 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1276 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:16.427765 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:16.437513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0468d99c-f416-4acb-a947-1ab448b50e66 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.383858 Sep 29 02:13:16.438097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 28/58] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:16 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:16.591709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:16.592468 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:16.599432 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.599908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.600333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.601071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.601513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.601925 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.754593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:16.763919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3e073d4-1624-479e-87e3-f5b4f87f4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.178633 Sep 29 02:13:16.764443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 31/59] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:16 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:16.803061 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-133998a2-422b-48ae-a7e4-706f2f23d38a req-95dcb11e-e696-4b43-ae65-07d542260a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65686a2-ff71-452b-bcfe-c81dcbf741f9", "tag": "bed0985a-cae7-47c3-8b9d-3c76eb77b4e4"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:16.818828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-133998a2-422b-48ae-a7e4-706f2f23d38a req-95dcb11e-e696-4b43-ae65-07d542260a77 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.819818 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-133998a2-422b-48ae-a7e4-706f2f23d38a req-95dcb11e-e696-4b43-ae65-07d542260a77 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.820395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-133998a2-422b-48ae-a7e4-706f2f23d38a req-95dcb11e-e696-4b43-ae65-07d542260a77 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.835199 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-133998a2-422b-48ae-a7e4-706f2f23d38a req-95dcb11e-e696-4b43-ae65-07d542260a77 service nova] Creating event network-changed:bed0985a-cae7-47c3-8b9d-3c76eb77b4e4 for instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 on hv-cinder-73306 Sep 29 02:13:16.841862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-133998a2-422b-48ae-a7e4-706f2f23d38a req-95dcb11e-e696-4b43-ae65-07d542260a77 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046192 Sep 29 02:13:16.843003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 29/60] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:16.937781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:16.938640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:16.944989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.945496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.945922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:16.946922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:16.947724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:16.949367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.173823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:17.174624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:17.181974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.181974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.182475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.183046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.183168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.183614 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.184036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.191363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff4b96fe-4f6e-49ca-8058-75baccec59f9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.257745 Sep 29 02:13:17.192106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 32/61] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:16 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:17.295886 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:17.296503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:17.302771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.303434 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.304122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.304818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.305271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.305777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.343405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.355042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-27847b4f-598e-4c6a-b6cc-84f74af02c08 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.185346 Sep 29 02:13:17.355654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 30/62] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:17 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:17.371579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.381031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.382591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.383875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47473d84-b56b-4a56-a0df-e7acc11f5b33 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1276 microversion: 2.20 time: 0.099022 Sep 29 02:13:17.384503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 33/63] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:17 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:17.465096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:17.466286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:17.472890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.473394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.473827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.474550 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.475003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.475415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.613393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.621222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3ffe8713-2f08-46eb-9048-06cc15472c18 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.161436 Sep 29 02:13:17.621955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 31/64] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:17 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:17.787953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:17.788743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:17.795294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.795781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.796219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.796908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:17.797349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:17.797777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:17.944681 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:17.952782 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e76cd553-b893-4f8f-bb0c-d31e79e3b6a2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.168858 Sep 29 02:13:17.953341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 34/65] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:17 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:18.215958 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:18.216639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:18.223006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.223557 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.224016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.224652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.225119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.225503 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.360666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:18.368589 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5b5fb554-57f9-4bc5-b5bd-3f8c9063f3ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.157193 Sep 29 02:13:18.369369 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 32/66] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:18 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:18.377862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:18.378495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:18.384870 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.385481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.386161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.386887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.387356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.387790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.408773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:18.409383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:18.416135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.416767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.417324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.418144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.418678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.419348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.494326 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:18.502857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:18.504247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:18.505370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0c6119d3-f7ed-45f4-bfea-e620b87382eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1276 microversion: 2.20 time: 0.100491 Sep 29 02:13:18.506192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:18 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1276 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:18.543820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:18.552021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01851409-62a0-4897-a9c8-bed9762e8ef8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.178480 Sep 29 02:13:18.552644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 35/68] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:18 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:18.644658 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:18.645256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:18.651596 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.652075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.652505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.653185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.653631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.654077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.790252 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:18.799124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-02925533-4bc6-4a0f-83d6-d7d56abbf33c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.158316 Sep 29 02:13:18.799699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:18 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:18.976382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:18.976943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:18.989474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.990233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.990847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:18.991925 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:18.992566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:18.992995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.223143 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=30 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:19.377685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:19.385603 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b3ed20d0-fac2-4689-bdbd-0850a5a7d2cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.413074 Sep 29 02:13:19.386423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 36/70] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:18 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:19.393144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:19.393764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:19.400408 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.401039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.401662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.402763 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.403466 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.404125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.531405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:19.532746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:19.545246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.546106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.546689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.547578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.548178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.550530 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.870630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:19.879862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:19.881810 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:19.883120 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dcee9d5a-d7b2-481b-90d4-360b4f621fab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1332 microversion: 2.20 time: 0.357433 Sep 29 02:13:19.884386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 37/71] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:19 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1332 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:19.894329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:19.895355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:19.902709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.903684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.904304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.905148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.905688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.906231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.968393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:19.978303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-076a8701-f0bd-49ed-8ac9-d624cccb10c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.589337 Sep 29 02:13:19.979188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 35/72] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:19 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:19.984060 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:19.984662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:19.990493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.990965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.991714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:19.992399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:19.992840 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:19.993393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:20.150320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:20.156869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:20.159727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a416c268-ddde-4d16-9af1-e1839b258b66 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.273997 Sep 29 02:13:20.160391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 38/73] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:19 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:20.164993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0989fced-a3e5-40c3-898b-0dd4a64542f2 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.184976 Sep 29 02:13:20.165591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 36/74] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:19 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:20.408972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:20.409787 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:20.418938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:20.419518 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:20.420036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:20.420742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:20.421202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:20.421623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:20.555620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:20.563735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fac415b3-34e2-4806-af3b-c177c92c3546 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.158818 Sep 29 02:13:20.564309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 39/75] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:20 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:20.911202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:20.912502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:20.919781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:20.920576 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:20.921711 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:20.921821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:20.922288 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:20.922710 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:20.986323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:20.994505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:20.996238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:20.998035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e11c1e93-5506-4e3a-9d7c-74b9eef1107d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.091329 Sep 29 02:13:20.998035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 37/76] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:20 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:21.004357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:21.005011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:21.011214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.011990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.012575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.013255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.013698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.014346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.152830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:21.160715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b8b0847f-18e3-4df9-a50a-db82ed921584 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.160243 Sep 29 02:13:21.161245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 40/77] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:20 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:21.188228 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:21.188712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:21.188821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:21.189309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:21.194891 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.195377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.195623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.195834 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.196109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.196542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.196650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.197010 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.197254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.197433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.197703 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.199019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.249297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.334901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:21.338248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:21.342931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=8 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.349275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7366796a-e961-4e1a-a4a3-68e6743f5610 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.164521 Sep 29 02:13:21.349851 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 41/78] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:21 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:21.350370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-23c83aca-e4c9-462d-add9-b126ad61ba56 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.169494 Sep 29 02:13:21.351017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 38/79] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:21 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:21.588659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:21.589247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:21.597807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.598682 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.599185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.600210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:21.600678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:21.601102 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:21.606173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:21.740076 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:21.749095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9c31bba-9210-41e1-8e35-5ec375a9df47 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.165640 Sep 29 02:13:21.749650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 42/80] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:21 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:22.023509 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:22.024154 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:22.031200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.031686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.032114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.032802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.033246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.033656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.101345 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.110328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.111819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.112978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ee9b81ab-0466-4e24-9229-752bc79e0aae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.094346 Sep 29 02:13:22.113739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 39/81] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:22 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:22.184673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:22.185743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:22.191409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.191890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.192323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.193018 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.193459 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.193878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.330102 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.338398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-242c3428-79eb-450d-a47e-b7f46e6d2f46 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.157599 Sep 29 02:13:22.338957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 43/82] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:22 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:22.372637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:22.373327 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:22.374453 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:22.375229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:22.379590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.380126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.380750 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.381245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.381424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.381756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.382051 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.382367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.382475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.383044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.383489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.383901 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.385027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:22.540492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.545130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.550782 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0154bded-8bfb-4947-942e-f64e1b1e613c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.180313 Sep 29 02:13:22.551464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 44/83] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:22 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:22.553260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b12db285-5365-42cc-95a4-4561d8b6cf82 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.185046 Sep 29 02:13:22.553819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 40/84] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:22 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:22.773596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:22.774220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:22.780219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.780709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.781132 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.781823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:22.782294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:22.782690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:22.913481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:22.923516 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-43ac6ab3-1371-417f-a2c4-a7b8f5c75aeb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.153630 Sep 29 02:13:22.924196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 45/85] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:22 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:23.138673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:23.139251 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:23.145761 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.146281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.146714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.147390 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.147836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.148247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.209767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:23.219222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:23.220649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:23.221748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1158d5b8-9e2e-448c-a528-00176fb39475 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.087310 Sep 29 02:13:23.222347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 41/86] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:23 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:23.365313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:23.366328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:23.377389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.378292 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.379028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.380175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.380944 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.381652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.519318 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:23.527055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9bf4440e-030a-4937-b681-a2602040485d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.167810 Sep 29 02:13:23.527627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 46/87] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:23 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:23.574264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:23.574901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:23.576295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:23.577289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:23.587562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.587562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.587562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.587562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.587897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.587897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.588056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.588056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.588056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.588056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.588353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.588353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.717893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:23.720986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:23.727891 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-567beecb-3f36-4463-a65c-eee5d83d21f3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.157691 Sep 29 02:13:23.728463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 42/88] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:23 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:23.728588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a32cff13-761c-49b4-a90b-10215010ab72 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.157043 Sep 29 02:13:23.729105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 47/89] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:23 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:23.946868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:23.947389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:23.953987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.954497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.954922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:23.955598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:23.956042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:23.956455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.095951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.104024 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7066ae3b-ed16-4807-b4cf-1c247c9ee84b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.161185 Sep 29 02:13:24.104584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 43/90] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:23 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:24.250580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:24.251427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:24.260516 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.261451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.262052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.263096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.263910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.264509 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.335069 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.344233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.345666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.346788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-33e58d2f-a00e-4ff6-8634-46b637cd5568 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.102304 Sep 29 02:13:24.347342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 48/91] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:24 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:24.551125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:24.551493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:24.557822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.558349 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.558787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.559671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.560046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.560472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.691862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.699895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-38476719-1eb8-4a64-9f07-c3709cac33f5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.153105 Sep 29 02:13:24.701056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 44/92] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:24 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:24.751136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:24.751680 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:24.751806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:24.751892 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:24.758538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.758789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.758985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.759362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.759511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.759798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.760102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.760497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:24.760631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.760947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.761176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:24.761367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:24.890448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.894366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:24.898600 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1c250238-882b-4305-b06d-f9452a922aba tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.151110 Sep 29 02:13:24.899259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 45/93] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:24 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:24.902380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-806264bd-1e3f-4967-91fe-866818fdca06 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.155111 Sep 29 02:13:24.903023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 49/94] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:24 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:25.131332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:25.132192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:25.142561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.143351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.144073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.145177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.145924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.146652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.279513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:25.287257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a59da88e-42ae-4a73-a31f-8e1e6d2be3f1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.162588 Sep 29 02:13:25.287822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 46/95] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:25 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:25.375123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:25.375979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:25.385011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.385604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.386273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.387245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.388424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.388886 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.461107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:25.473885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:25.476032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:25.477724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-efe0347d-78c6-424f-b8c0-5e3b6792b7e2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.108854 Sep 29 02:13:25.478513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 50/96] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:25 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:25.723311 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:25.723914 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:25.729940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.730446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.730870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.731585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.732024 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.732424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.866993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:25.875482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c9aaf6fa-9ec5-4259-97c2-19b4d70f6876 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.156023 Sep 29 02:13:25.876127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 47/97] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:25 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:25.922036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:25.922637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:25.924746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:25.925507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:25.929182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.929602 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.930092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.930789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.931223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.931339 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.931646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.931856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.932214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:25.932916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:25.933372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:25.933768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:26.065884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:26.070285 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:26.080207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-066f386a-04e0-4f1e-a233-321ec32d0dc7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.159138 Sep 29 02:13:26.080814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 48/98] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:25 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:26.081648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a82dbb46-01e8-41f3-8616-f3db78c5c2ab tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.164306 Sep 29 02:13:26.082215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 51/99] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:25 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:26.314672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:26.315672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:26.325938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:26.326454 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:26.326876 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:26.327557 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:26.327999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:26.328412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:26.472718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:26.480479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-18db1dfe-179e-44f0-955f-ec889ad4dec6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.172569 Sep 29 02:13:26.481043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 49/100] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:26 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:26.503346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:26.503949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:26.510243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:26.510721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:26.511143 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:26.511841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:26.512263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:26.512679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:26.577202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:26.585691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:26.586989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:26.588109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bd19a3cd-bd32-4131-829a-417c0c90aa5e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.088693 Sep 29 02:13:26.588946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 52/101] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:26 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:26.899218 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:26.900278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:26.908492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:26.909141 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:26.909828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:26.910858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:26.911394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:26.911928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.045113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.053367 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1bfceb4e-b129-46f4-9875-c05c72844f49 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.159222 Sep 29 02:13:27.053934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 50/102] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:26 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:27.105043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:27.105717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:27.112580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.113365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:27.113901 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.114086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:27.114482 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.115294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.115842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.116893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.119997 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.120660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.121112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.121756 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.122412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.122836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.379011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.386741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fc598749-1f6a-4c43-af83-4b135a671bf1 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.277117 Sep 29 02:13:27.387317 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 51/103] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:27 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:27.396860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.405097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a32b46e5-1fbb-4fe6-9bab-ad638deee530 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.303930 Sep 29 02:13:27.405961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 53/104] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:27 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:27.506047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:27.506968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:27.515835 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.516315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.516743 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.517424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.517871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.518317 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.614333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:27.615014 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:27.621286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.621849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.622357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.623135 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:27.625941 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:27.626439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:27.651924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.660107 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d7bb9035-3f12-44eb-90e5-71a4a49575ff tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.160028 Sep 29 02:13:27.663018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 52/105] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:27 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:27.691059 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.699402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.700830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:27.701928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a20c1c06-4ab2-4daa-9a6a-40ef0d1a9d28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.091650 Sep 29 02:13:27.702650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 54/106] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:27 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:28.077938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:28.078880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:28.087292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.088321 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.088790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.089850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.090592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.091967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.291331 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.302331 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-741f036c-972f-4fd3-94a7-cca6695217d4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.226968 Sep 29 02:13:28.311030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 53/107] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:28 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:28.410047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:28.411297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:28.418114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.418746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.419180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.419864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.420303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.420931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.430777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:28.431585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:28.446994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.449230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.450034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.452413 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.452974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.453433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.614322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.624950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c78b3a35-51a5-43fe-b5a5-6b4135239baa tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.218703 Sep 29 02:13:28.625935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 55/108] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:28 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:28.631603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.640096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3f76b3bf-236c-42f7-96d4-b4a34900e36e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.215158 Sep 29 02:13:28.640844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 54/109] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:28 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:28.683660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:28.684404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:28.690733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.691278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.691766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.692509 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.693017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.693505 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.727319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:28.727919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:28.734446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.735100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.735694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.736534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:28.737121 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:28.737675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:28.808648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.818067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.819719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.821141 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ac88083f-b2a7-43bb-bece-f9e3f5027f0f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1340 microversion: 2.20 time: 0.097802 Sep 29 02:13:28.821967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 55/110] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:28 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1340 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:28.854745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:28.863296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cefa73ac-05fa-4a44-b379-b32c473e5d12 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.183604 Sep 29 02:13:28.863881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 56/111] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:28 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:29.324851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:29.325654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:29.333476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:29.334147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:29.334679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:29.335506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:29.336156 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:29.336642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:29.600455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:29.603773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:29.614918 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-90e68929-d6a8-4d82-b319-e79c6aeb964b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.293706 Sep 29 02:13:29.615804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 56/112] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:29 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:29.651054 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:29.651668 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:29.663752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:29.664645 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:29.674188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:29.674765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:29.675200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:29.675915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:29.680428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:29.680941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:29.681679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:29.682174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:29.683728 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:29.684528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:29.684979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:29.685396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.155907 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.167077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-649733b2-f994-40f1-a9f7-0f11aa2938eb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.507391 Sep 29 02:13:30.167901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 57/113] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:29 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:30.175417 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:30.178612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:30.188679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:30.189090 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:30.189820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.190813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:30.191418 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:30.192179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.350946 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.360505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.362030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.363440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4d7e28fc-9cd8-45da-94d9-1038b15fd8ed tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1338 microversion: 2.20 time: 0.194414 Sep 29 02:13:30.364178 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 58/114] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:30 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1338 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:30.368977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:30.369789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:30.378517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:30.379285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:30.379900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.381441 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:30.382649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:30.383285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.685671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.697014 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-35c0bbb0-2f81-4840-b728-4243efe95f8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.331369 Sep 29 02:13:30.706286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 59/115] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:30 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:30.713721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:30.713721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:30.714746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:30.715157 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:30.715590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.716641 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:30.717203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:30.717788 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:30.869725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.871579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:30.878460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-acfa25d3-51e9-48bc-a70d-48666c263930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.174369 Sep 29 02:13:30.879042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 60/116] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:30 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:30.885203 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0e62eaa2-8414-4703-b788-f73883a68af3 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 1.238003 Sep 29 02:13:30.886230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 57/117] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:29 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:31.196100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:31.196877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:31.210740 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.212298 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.213349 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.214323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.215122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.216957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.390577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:31.391438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:31.401295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.405043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.406533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.408791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.409417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.411785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.484602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:31.497895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0e73e49e-cb53-46df-a7ae-90a16c13aa58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.304597 Sep 29 02:13:31.514944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 61/118] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:31 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:31.560221 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:31.565772 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:31.582522 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:31.586213 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:31.588629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-687414ae-8f4f-449f-b426-8bbb9cd35d7c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1338 microversion: 2.20 time: 0.202418 Sep 29 02:13:31.601492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 58/119] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:31 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1338 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:31.732059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:31.732653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:31.748404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.748801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.749390 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.750181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.750620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.751033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.909514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:31.911256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:31.921085 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.925910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.926434 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:31.927156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:31.928045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:31.928045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.069206 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.080844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8954c1a3-be0e-48cd-b005-b6504d9ab09d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.362463 Sep 29 02:13:32.082068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 62/120] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:31 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:32.090329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:32.094944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:32.106523 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.107306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.107992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.109355 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.110068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.111199 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.161910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.170443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2d5fd45-94ae-4ad0-82bb-61dcedf18e4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.265366 Sep 29 02:13:32.171733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 59/121] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:31 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:32.297183 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.305424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e1f39d87-43d3-4170-b475-b6c23688d5b6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.221117 Sep 29 02:13:32.306826 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 63/122] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:32 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:32.415237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-3d53fa75-3a69-42d8-a477-b6968a60132a req-58720891-e99f-4e74-b1b4-2c628e1578a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9884b6fc-bf84-48e8-8f73-b80408c9b348", "name": "network-vif-plugged", "status": "completed", "tag": "62cb9340-38dd-43f9-a051-285ad5137842"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:32.426988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3d53fa75-3a69-42d8-a477-b6968a60132a req-58720891-e99f-4e74-b1b4-2c628e1578a9 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.427807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3d53fa75-3a69-42d8-a477-b6968a60132a req-58720891-e99f-4e74-b1b4-2c628e1578a9 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.428355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-3d53fa75-3a69-42d8-a477-b6968a60132a req-58720891-e99f-4e74-b1b4-2c628e1578a9 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.441844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-3d53fa75-3a69-42d8-a477-b6968a60132a req-58720891-e99f-4e74-b1b4-2c628e1578a9 service nova] Creating event network-vif-plugged:62cb9340-38dd-43f9-a051-285ad5137842 for instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 on hv-cinder-73306 Sep 29 02:13:32.447330 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-3d53fa75-3a69-42d8-a477-b6968a60132a req-58720891-e99f-4e74-b1b4-2c628e1578a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274176 Sep 29 02:13:32.447930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 60/123] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:32.527698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:32.528812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:32.535381 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.536087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.536519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.537209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.537806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.538413 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.615577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:32.616580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:32.626289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.626924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.627591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.628744 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:32.631314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:32.638444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:32.760851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.792937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4fb004f9-49ac-43fa-b3d2-f523b61039a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.270025 Sep 29 02:13:32.806099 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 64/124] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:32 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:32.836649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.845369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.846843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:32.847953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e4e7b63-10a0-407a-b283-bb8f86cb5986 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.236975 Sep 29 02:13:32.848514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 61/125] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:32 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:33.105432 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:33.106068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:33.109335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:33.113232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.113941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.114533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.115234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.115679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.116260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.197690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:33.198998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:33.206130 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.206617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.207087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.210258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.210911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.211872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.316216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:33.331004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c2531337-6d92-48e1-91e4-81ba0353fa70 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.227760 Sep 29 02:13:33.332698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 65/126] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:33 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:33.339162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:33.339768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:33.353019 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.353547 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.354311 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.355018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.355616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.356746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.382374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:33.396537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b9043eb-fa22-494e-aee5-863295ef09cd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.202801 Sep 29 02:13:33.398813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 62/127] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:33 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:33.501360 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:33.508977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a178a4cc-083c-4f7a-ac80-d59b756595c6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.175161 Sep 29 02:13:33.509705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 66/128] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:33 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:33.818698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:33.819309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:33.826092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.826576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.827001 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.827777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.828919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.828919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.878147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:33.879352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:33.889892 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.890405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.890827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.891519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:33.891963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:33.892392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:33.983765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:33.997171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3826e51e-b439-4a92-aa6a-30602a43db7e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.182293 Sep 29 02:13:34.008990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 63/129] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:33 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:34.040541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:34.052919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:34.054393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:34.055644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c190403b-2d5a-4924-90c2-41595ccfd865 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.182189 Sep 29 02:13:34.056365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 67/130] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:33 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:34.355628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:34.356200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:34.362437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:34.362946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:34.363369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:34.364043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:34.364482 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:34.364889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:34.427273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:34.427879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:34.434229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:34.434747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:34.435173 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:34.435902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:34.436346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:34.436778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:34.504066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:34.512103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-debdc01f-39e6-4563-81d1-37a5cc4d791a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.160342 Sep 29 02:13:34.512930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 64/131] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:34 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:34.539847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:34.540679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:34.553511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:34.554299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:34.554734 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:34.555800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:34.557056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:34.557478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:34.584884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:34.593904 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1a3baf6d-fb40-40c9-9219-f199de4ce1c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.171015 Sep 29 02:13:34.594505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 68/132] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:34 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:34.695091 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:34.702996 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-749aca8d-aafc-4500-b61a-779134f613ec tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.174236 Sep 29 02:13:34.703557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 65/133] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:34 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:35.020936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:35.021564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:35.027717 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.028200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.028620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.029302 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.029752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.030199 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.080795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:35.081401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:35.087577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.088055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.088477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.089155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.089592 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.090037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.189610 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.201273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e28156f2-eb0e-4e5f-aef3-bf3ba336d057 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.184256 Sep 29 02:13:35.203518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 69/134] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:35 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:35.240768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.249840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.251425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.252616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-98dfb228-7917-4442-af91-24d212a32358 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.175995 Sep 29 02:13:35.253174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 66/135] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:35 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:35.539143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:35.539747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:35.546069 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.546945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.551103 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.551343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.552047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.552474 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.616793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:35.625707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:35.636047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.636537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.637794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.638830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.639029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.639403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.728350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.737617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-52de3521-cb0c-48ef-9f55-5daa52d27c31 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.202604 Sep 29 02:13:35.738270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 70/136] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:35 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:35.743061 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:35.743861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:35.749653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.750368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.750797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.751560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:35.751905 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:35.752412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:35.814952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.825339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-043b277e-d8e1-4234-a3b2-cf4318838219 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.212306 Sep 29 02:13:35.838417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 67/137] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:35 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:35.916240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:35.925138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3a6ff289-8927-45b0-950b-7a8e2f4ffe0d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.185867 Sep 29 02:13:35.925715 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 71/138] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:35 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:36.227144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:36.227826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:36.231201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:36.235781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.236265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.236695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.237376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.237820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.238262 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.278016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:36.278613 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:36.285387 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.286105 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.286707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.287398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.287843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.288258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.395540 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:36.409807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7f2e1e06-6f23-4c1d-9512-c09d09d2fe7b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.185569 Sep 29 02:13:36.411284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 68/139] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:36 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:36.442106 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:36.451039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:36.452503 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:36.453827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-240df114-aa9d-4592-b85b-9349cd8f544a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.179624 Sep 29 02:13:36.462818 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 72/140] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:36 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:36.761645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:36.762251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:36.768632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.769107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.769555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.770257 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.770695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.771107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.852693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:36.853318 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:36.860224 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.860986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.861415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.862139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:36.862592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:36.863011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:36.879172 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:37.064734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.093057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-bb9a5dfe-c2c9-43b4-8137-edf671b3e1e3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.229865 Sep 29 02:13:37.095184 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 73/141] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:36 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:37.102444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.114746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:37.115854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:37.119799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c6e7182-ef3b-4934-a1c5-3c7331c668ca tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.361130 Sep 29 02:13:37.124226 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:37.125032 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:37.125700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:37.126240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 69/142] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:36 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:37.127419 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:37.128057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:37.128931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:37.311724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.321536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-18caefc9-4dd6-40b7-8fb1-0597e787c228 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.223680 Sep 29 02:13:37.322361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 74/143] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:37 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:37.436521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:37.437362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:37.444721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:37.445245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:37.445796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:37.446462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:37.446902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:37.447720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:37.478349 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:37.478959 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:37.488345 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:37.489292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:37.489741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:37.490538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:37.492897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:37.493363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:37.660478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.671059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.673232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.674415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d12c6f95-f41c-4757-9836-bd5b8c4de388 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.199897 Sep 29 02:13:37.687168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 75/144] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:37 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:37.714027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:37.723057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97ffdd40-f1a8-4c7b-9647-e32081bb127c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.290966 Sep 29 02:13:37.726762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 70/145] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:37 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:37.973708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-77e59a23-2837-44d2-8c5e-f32ea0b6ce03 req-9d0cf277-9f98-4630-b68e-34570412b78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:38.001507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-77e59a23-2837-44d2-8c5e-f32ea0b6ce03 req-9d0cf277-9f98-4630-b68e-34570412b78d service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.001978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-77e59a23-2837-44d2-8c5e-f32ea0b6ce03 req-9d0cf277-9f98-4630-b68e-34570412b78d service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.002421 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-77e59a23-2837-44d2-8c5e-f32ea0b6ce03 req-9d0cf277-9f98-4630-b68e-34570412b78d service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.021395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-77e59a23-2837-44d2-8c5e-f32ea0b6ce03 req-9d0cf277-9f98-4630-b68e-34570412b78d service nova] Creating event network-changed:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:13:38.026824 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-77e59a23-2837-44d2-8c5e-f32ea0b6ce03 req-9d0cf277-9f98-4630-b68e-34570412b78d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061564 Sep 29 02:13:38.027406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 76/146] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:38.117948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:38.118672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:38.131043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.131043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.131043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.131043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.134292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-a95b0903-a02c-4c14-a044-22d1b1fc45bf req-eeafc9ac-295a-466a-9a7a-d5fe835a4de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d6d291-847b-4e09-b49e-4c5ec0dfae6c", "name": "network-vif-plugged", "status": "completed", "tag": "d183c6c3-e338-4c72-a436-81e93d6fc258"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:38.137946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.138445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.150921 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-a95b0903-a02c-4c14-a044-22d1b1fc45bf req-eeafc9ac-295a-466a-9a7a-d5fe835a4de2 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.151455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-a95b0903-a02c-4c14-a044-22d1b1fc45bf req-eeafc9ac-295a-466a-9a7a-d5fe835a4de2 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.151909 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-a95b0903-a02c-4c14-a044-22d1b1fc45bf req-eeafc9ac-295a-466a-9a7a-d5fe835a4de2 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.173278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-a95b0903-a02c-4c14-a044-22d1b1fc45bf req-eeafc9ac-295a-466a-9a7a-d5fe835a4de2 service nova] Creating event network-vif-plugged:d183c6c3-e338-4c72-a436-81e93d6fc258 for instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c on hv-cinder-73306 Sep 29 02:13:38.180028 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-a95b0903-a02c-4c14-a044-22d1b1fc45bf req-eeafc9ac-295a-466a-9a7a-d5fe835a4de2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049375 Sep 29 02:13:38.180686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 77/147] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:13:38.186307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:38.187367 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:38.196391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.197312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.198116 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.198944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.199622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.200167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.360945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.361534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.368872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0306015b-596f-4151-bc49-30a242f06aa2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.187032 Sep 29 02:13:38.369223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7d16af5-edb3-40c6-b37a-dc03183498ad tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.255361 Sep 29 02:13:38.369443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 78/148] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:38 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:38.369787 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 71/149] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:38 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:38.374314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:38.374966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:38.380781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.381251 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.381832 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.382719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.383172 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.383590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.517564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.525459 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-58bfd5c7-7805-48e2-a4c5-2bb159d04c0a tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.154667 Sep 29 02:13:38.525962 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 79/150] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:38 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:38.701497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:38.702036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:38.708573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.709059 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.709468 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.711638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.712098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.712517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.754875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:38.758244 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:38.784578 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.785101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.785526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.786673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:38.786807 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:38.787142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:38.871637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.882021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.883666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.884869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd828db2-7179-461f-9727-606205aa2995 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.187835 Sep 29 02:13:38.885450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 72/151] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:38 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:38.925059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:38.932849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3de2a594-ab2c-4f58-a15c-98157d871528 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.187928 Sep 29 02:13:38.933409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 80/152] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:38 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:39.391728 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:39.392350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:39.393558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:39.394695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:39.398428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.398932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.399346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.400476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.400864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.401264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.402945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.403463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.403877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.404830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.405609 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.406295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.556869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:39.560982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:39.565823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-969b3a86-b85e-4930-a9f3-783bf463ccc0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.177889 Sep 29 02:13:39.566443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 73/153] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:39 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:39.569335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0534c0b9-df3b-434e-a3fd-34b2bd774ddb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.180985 Sep 29 02:13:39.570086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 81/154] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:39 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:39.583691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:39.584305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:39.594769 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.595260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.595914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.596615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.597066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.597484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.745283 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:39.753684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-12b173fa-30de-49e2-afe8-30d96bb52ef9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.185902 Sep 29 02:13:39.754313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 74/155] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:39 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:39.909925 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:39.910045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:39.916415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.916897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.917299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.917990 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.918522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.918929 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.957217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:39.968079 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:39.976087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.976733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.977702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:39.978543 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:39.979047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:39.980280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.070902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.079538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.080978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.082115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3222320e-b637-4113-b24e-7ed740e1a246 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.176961 Sep 29 02:13:40.082644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 82/156] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:39 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:40.121684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.129594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-365d5fbc-2e53-464d-932e-984dedd5ca7f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.177179 Sep 29 02:13:40.130185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 75/157] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:39 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:40.211479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-3816f422-26ab-4e0a-868b-4c10867d8433 req-18d02a2f-f3b4-44c7-879a-279e8dc3c0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcb7821-6480-46f9-a220-78d1214f7181", "name": "network-vif-plugged", "status": "completed", "tag": "8d6a66c4-84ec-4b80-817a-4a5dfdc81a64"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:40.224835 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3816f422-26ab-4e0a-868b-4c10867d8433 req-18d02a2f-f3b4-44c7-879a-279e8dc3c0a7 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.225307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3816f422-26ab-4e0a-868b-4c10867d8433 req-18d02a2f-f3b4-44c7-879a-279e8dc3c0a7 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.225729 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3816f422-26ab-4e0a-868b-4c10867d8433 req-18d02a2f-f3b4-44c7-879a-279e8dc3c0a7 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.238583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-3816f422-26ab-4e0a-868b-4c10867d8433 req-18d02a2f-f3b4-44c7-879a-279e8dc3c0a7 service nova] Creating event network-vif-plugged:8d6a66c4-84ec-4b80-817a-4a5dfdc81a64 for instance 1bcb7821-6480-46f9-a220-78d1214f7181 on hv-cinder-73306 Sep 29 02:13:40.243961 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-3816f422-26ab-4e0a-868b-4c10867d8433 req-18d02a2f-f3b4-44c7-879a-279e8dc3c0a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040912 Sep 29 02:13:40.244547 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 83/158] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:40.588925 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:40.589552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:40.595863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.596346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.596771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.597452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.597905 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.598336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.598539 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:40.599238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:40.602502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:40.606223 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.606707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.607185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.607872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.608351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.608767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.747882 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.754585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.759783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c232bdcc-4d6f-448e-aafc-2f2cfff15729 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.174739 Sep 29 02:13:40.760533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 76/159] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:40 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:40.762790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0224fd97-7000-4928-a86a-8937b928b0cb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.169470 Sep 29 02:13:40.763346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 84/160] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:40 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:40.777011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:40.777680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:40.784150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.784677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.785160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.785894 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:40.786420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:40.786837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:40.922330 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:40.930140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-420bdfdf-0be0-450c-8065-92fa43a7dfb9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.156960 Sep 29 02:13:40.930711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 77/161] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:40 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:41.107456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:41.108293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:41.115593 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.116386 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.117195 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.118168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.118619 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.119379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.162541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:41.163381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:41.174927 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.175895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.176386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.177160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.190559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.191033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.303407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:41.317785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:41.319348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:41.320675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-917fddb8-0a36-496f-a1e9-1394a7acbea6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.217459 Sep 29 02:13:41.321416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 85/162] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:41 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:41.357733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:41.368021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f067175-d824-43c6-8a62-5aa7346ada9c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.219038 Sep 29 02:13:41.370049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 78/163] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:41 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:41.782944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:41.784031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:41.791757 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.792442 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.793250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.794488 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.796985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:41.796985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:41.798517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.799180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.804511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.805028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.805520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.806342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.806852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.807339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.966526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:41.975791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7d75a5a7-1a0b-4f0b-8a03-49c9626000b1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.197110 Sep 29 02:13:41.976638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 86/164] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:41 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:41.983086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:41.984127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:41.993236 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.993721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.994185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:41.994869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:41.995471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:41.996029 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:42.008921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:42.019077 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7c088f6-3d32-40b5-af09-324df572bc26 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.227460 Sep 29 02:13:42.019672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 79/165] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:41 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:42.160326 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:42.168192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d0a54690-844f-41d9-93eb-8cc4e397abc8 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.189651 Sep 29 02:13:42.168744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 87/166] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:41 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:42.347991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:42.348596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:42.356328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:42.356840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:42.357290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:42.358225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:42.358825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:42.360287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:42.394510 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:42.395181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:42.401909 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:42.402560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:42.402995 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:42.403862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:42.404314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:42.404735 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:42.526068 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:42.527219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:42.528923 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:42.538945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fbaa560d-93ba-4f94-9b46-495a93d7eb2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.195528 Sep 29 02:13:42.539736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 80/167] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:42 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:42.615982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:42.622659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c45e21b1-2b23-43d4-b926-57cacf9028a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.235217 Sep 29 02:13:42.623293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 88/168] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:42 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:43.001784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:43.002398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:43.008394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.009025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.009605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.010525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.010936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.011517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.044626 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:43.045725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:43.055936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.056882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.061166 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.061874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.063066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.063721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.200394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:43.210579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bdad3f35-0ad9-4689-9010-0f7d9db6bff6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.212561 Sep 29 02:13:43.212331 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 81/169] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:42 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:43.217594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:43.218217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:43.238812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.239478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.252747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:43.252747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-de44d04c-a724-4081-9d87-7b3dd038308f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.211242 Sep 29 02:13:43.252747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 89/170] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:43 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:43.253583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.254541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.255289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.255673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.431411 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:43.441042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e64ac3b7-7b8b-4d63-85c3-acaf6408cfed tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.227523 Sep 29 02:13:43.470768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 82/171] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:43 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:43.564789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:43.565423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:43.571554 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.572132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.572466 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.573153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.573602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.574045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.647147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:43.648023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:43.654406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.654844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.655254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.655869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:43.656859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:43.657278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:43.717450 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:43.733149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:43.736001 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:43.738759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1bd41dfd-17a6-4595-bc7e-9a76950fe2d3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.177281 Sep 29 02:13:43.744213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 90/172] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:43 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:44.026713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.034940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a6af5913-34e9-4847-9b8a-e100c01a62df tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.392659 Sep 29 02:13:44.035524 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 83/173] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:43 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:44.235623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:44.236223 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:44.242194 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.242666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.243079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.243750 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.244185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.244626 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.279158 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:44.280086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:44.286506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.287082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.287506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.288197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.288960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.289442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.380370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.388194 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-cb52471d-4e43-419e-9f85-494af4d8b61a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.156401 Sep 29 02:13:44.388684 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 91/174] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:44 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:44.422430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.430849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-73b585a3-fe9f-4413-8e7a-13f519b14440 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.155663 Sep 29 02:13:44.431783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 84/175] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:44 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:44.474119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:44.474648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:44.480909 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.481507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.481934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.482657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.483100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.483519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.487413 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:44.620122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.628965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4409fbf0-b189-4472-90d4-8a95d5f6c953 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.158721 Sep 29 02:13:44.629981 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 92/176] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:44 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:44.766431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:44.767277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:44.774375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.774838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.775267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.775949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:44.776395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:44.776837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:44.907219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.916207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.917688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:44.918865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-51455705-94e2-4cda-a424-c934f2a4fe05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.156719 Sep 29 02:13:44.919410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 85/177] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:44 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:45.059682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:45.060281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:45.067235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.067714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.068142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.068828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.069272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.069693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.208274 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:45.216355 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8feff9d3-7ccb-4bd0-abc3-374af0a14270 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.160784 Sep 29 02:13:45.216927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 93/178] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:45 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:45.411893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:45.412509 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:45.418747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.419229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.419655 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.420325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.420766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.421147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.456044 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:45.456847 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:45.463612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.464637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.465395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.466262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.467037 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.467943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.653694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:45.664066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fd089fbc-47eb-4264-9c57-b6eea3e5e290 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.213237 Sep 29 02:13:45.665197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 94/179] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:45 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:45.669979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:45.670886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:45.680439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.681168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.681764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.684218 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.685353 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.686134 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.766502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:45.788499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-141a47dc-6e78-4ebb-8b7e-dc9969a199a5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.380521 Sep 29 02:13:45.789089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 86/180] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:45 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:45.943998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:45.944837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:45.955739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.956239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.956663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:45.959114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:45.961328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:45.962661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.076134 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:46.090079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-305939af-c75f-4327-9e00-f0a5ca6cf63c tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.423546 Sep 29 02:13:46.090857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 95/181] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:45 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:46.240552 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:46.241295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:46.252657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:46.254268 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:46.254967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.257010 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:46.257693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:46.259508 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.389384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:46.408383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:46.412124 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:46.413692 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3a8abcbe-7bd9-4fd2-9fe5-91b66111b330 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.473614 Sep 29 02:13:46.427848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 87/182] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:45 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:13:46.478953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:46.487911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d1cf3f03-e951-4d57-8d61-d386deb3f4b8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.251877 Sep 29 02:13:46.488573 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 96/183] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:46 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:46.687028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:46.687918 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:46.694660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:46.695140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:46.695562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.696237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:46.696680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:46.697074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.816511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:46.817512 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:46.824551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:46.826263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:46.826970 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.827866 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:46.828576 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:46.829418 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:46.883929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:46.893198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-60e3c0b4-8eaf-42d3-88ec-908d8e1ce22e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.209816 Sep 29 02:13:46.894578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 88/184] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:46 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:47.076815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:47.084997 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d127b841-4320-4b99-b6a8-832eb51dea85 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.273054 Sep 29 02:13:47.098022 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 97/185] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:46 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:47.115307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:47.115915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:47.122409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.122888 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.123343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.124024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.124472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.124958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.258993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:47.268616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3884460b-0af7-4e29-ae0b-3888c740ed6f tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.157300 Sep 29 02:13:47.269188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 89/186] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:47 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:47.443560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:47.444376 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:47.453037 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.453888 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.454493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.455449 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.456055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.456616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.511421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:47.512052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:47.518838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.519492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.520543 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.521222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.521668 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.522752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.602478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:47.612180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:47.613910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:47.615087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-94e43a3a-47c9-4ab7-b9d9-6b3798b1bb61 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.177185 Sep 29 02:13:47.616325 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 98/187] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:47 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:47.686916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:47.695679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fcdb77b3-5cfb-41b2-852f-12e45494ef26 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.188236 Sep 29 02:13:47.696198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 90/188] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:47 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:47.916256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:47.916856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:47.923388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.923869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.924300 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:47.924980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:47.925425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:47.925838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.056039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.064237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ffaf89be-4722-4929-8591-aa220b381cbd tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.151959 Sep 29 02:13:48.064784 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 99/189] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:47 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:48.108795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:48.109504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:48.115788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.116267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.116693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.117376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.117986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.118429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.252237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.261138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-87ddb4c9-4779-4576-b1b3-3c8e16523519 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.156123 Sep 29 02:13:48.261786 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 91/190] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:48 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:48.292226 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:48.292825 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:48.299211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.299701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.300103 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.301176 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.301685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.302205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.453704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.462056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-32affbcd-6bc2-45f1-bb4b-c197a3c45d78 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.173596 Sep 29 02:13:48.462665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 100/191] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:48 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:48.641559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:48.641559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:48.647679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.648153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.648578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.649251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.649694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.650128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.724538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:48.725094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:48.736576 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.737895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.738503 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.739387 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.740277 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.741236 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.821816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.825206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:48.831048 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.833872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.835025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d3a32d7-821f-4f31-802e-a9174f58634c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.198227 Sep 29 02:13:48.835585 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 92/192] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:48 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:48.918100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1a0790b3-53b0-4716-9980-a4721e565f1d req-ff980fb7-2165-4a49-bbd4-7e59a0942be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65686a2-ff71-452b-bcfe-c81dcbf741f9", "name": "network-vif-plugged", "status": "completed", "tag": "bed0985a-cae7-47c3-8b9d-3c76eb77b4e4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:48.925502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:48.938668 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-135cfe72-ced4-4efd-8df3-827e750a75c2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.221787 Sep 29 02:13:48.939787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 101/193] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:48 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:48.944345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1a0790b3-53b0-4716-9980-a4721e565f1d req-ff980fb7-2165-4a49-bbd4-7e59a0942be5 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:48.945265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1a0790b3-53b0-4716-9980-a4721e565f1d req-ff980fb7-2165-4a49-bbd4-7e59a0942be5 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:48.945939 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1a0790b3-53b0-4716-9980-a4721e565f1d req-ff980fb7-2165-4a49-bbd4-7e59a0942be5 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:48.964792 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1a0790b3-53b0-4716-9980-a4721e565f1d req-ff980fb7-2165-4a49-bbd4-7e59a0942be5 service nova] Creating event network-vif-plugged:bed0985a-cae7-47c3-8b9d-3c76eb77b4e4 for instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 on hv-cinder-73306 Sep 29 02:13:48.972932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1a0790b3-53b0-4716-9980-a4721e565f1d req-ff980fb7-2165-4a49-bbd4-7e59a0942be5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058500 Sep 29 02:13:48.973695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 93/194] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:49.087771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:49.088397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:49.097079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.097568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.097990 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.098701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.099149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.099668 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.237758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:49.246025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e9e57a83-4fe2-4583-91dc-abf90d8b8562 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.162522 Sep 29 02:13:49.246628 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 102/195] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:49 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:49.285754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:49.286464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:49.292601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.293006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.293428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.294145 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.294593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.295002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.439231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:49.447428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-064100d7-0f6c-47ab-90a4-a0f3540e298b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.166204 Sep 29 02:13:49.447998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 94/196] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:49 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:49.484929 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:49.485541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:49.491923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.492408 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.492841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.493526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.493976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.494437 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.628719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:49.636612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-94b76d29-36f7-42a3-b656-ffa95757e46d tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.155735 Sep 29 02:13:49.637214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 103/197] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:49 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:49.865383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:49.866402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:49.876756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.877240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.877673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.878462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.878819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.879236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.964762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:49.965370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:49.971778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.972252 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.972677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:49.973350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:49.973790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:49.974241 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.012926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.021535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.022993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.024103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0fc94b90-7627-495f-a2f7-fdd377f1cb5f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.166092 Sep 29 02:13:50.024668 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 95/198] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:49 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:50.103320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.111146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-af3adbeb-24cf-418f-b437-842a1dfc4719 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.150332 Sep 29 02:13:50.111682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 104/199] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:49 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:50.271526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:50.272066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:50.278136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:50.278688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:50.279113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.279790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:50.280234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:50.280647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.416391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.424685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88debb07-c99f-498d-8aa6-fe147919b2af tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.157168 Sep 29 02:13:50.425254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 96/200] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:50 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:50.471955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:50.472559 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:50.478862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:50.479339 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:50.479766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.480453 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:50.480902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:50.481318 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.616186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.624366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d489d8b9-d6a0-4db5-ad7c-bdca6d434895 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.157277 Sep 29 02:13:50.624933 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 105/201] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:50 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:50.666481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:50.667142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:50.674205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:50.674679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:50.675105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.675843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:50.676307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:50.676695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:50.809414 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:50.821144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f5bf4325-db2d-4084-9155-7d72f1a4defb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.158385 Sep 29 02:13:50.822163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 97/202] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:50 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:50.998120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-9c6bc68c-4079-4aa7-8220-0e0c2173d49a req-d53ee08b-58f7-43ce-b459-fafc3e5ea48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122ad38e-8b7c-440d-99ab-e3c7063691ad", "name": "network-vif-plugged", "status": "completed", "tag": "870d1dee-af78-44b4-8d9b-36d459c3e5c4"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:51.009561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-9c6bc68c-4079-4aa7-8220-0e0c2173d49a req-d53ee08b-58f7-43ce-b459-fafc3e5ea48e service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.010362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-9c6bc68c-4079-4aa7-8220-0e0c2173d49a req-d53ee08b-58f7-43ce-b459-fafc3e5ea48e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.010971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-9c6bc68c-4079-4aa7-8220-0e0c2173d49a req-d53ee08b-58f7-43ce-b459-fafc3e5ea48e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.024400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-9c6bc68c-4079-4aa7-8220-0e0c2173d49a req-d53ee08b-58f7-43ce-b459-fafc3e5ea48e service nova] Creating event network-vif-plugged:870d1dee-af78-44b4-8d9b-36d459c3e5c4 for instance 122ad38e-8b7c-440d-99ab-e3c7063691ad on hv-cinder-73306 Sep 29 02:13:51.030036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-9c6bc68c-4079-4aa7-8220-0e0c2173d49a req-d53ee08b-58f7-43ce-b459-fafc3e5ea48e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035655 Sep 29 02:13:51.030606 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 106/203] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:51.050237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:51.050838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:51.056978 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.057456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.057878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.058580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.059017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.059429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.134644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:51.135354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:51.141701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.142240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.142673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.143362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.143816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.144233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.193377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.201685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.203162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.204266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66ba44f6-db08-4991-8a6a-0b5cd761b58e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.158501 Sep 29 02:13:51.204835 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 98/204] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:51 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:51.272321 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.280477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2bc1b57a-00fd-405b-8081-f45e499c9feb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.150087 Sep 29 02:13:51.281038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 107/205] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:51 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:51.453047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:51.454624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:51.465191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.465975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.466724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.468201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.469158 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.469727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.604287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.612269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24dc23b5-e164-4c86-b2f8-ba1f03b079f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.166782 Sep 29 02:13:51.612830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 99/206] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:51 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:51.647267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:51.647874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:51.653869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.654375 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.654798 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.655465 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.655904 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.656335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.792878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.800976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c7a0bc98-5118-436f-8add-e03fab9387c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.157638 Sep 29 02:13:51.801534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 108/207] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:51 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:51.847544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:51.848168 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:51.854598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.855076 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.855502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.856180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:51.856629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:51.857040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:51.990778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:51.999209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aefab50a-63b4-4e2a-9767-18b823f41fbb tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.156059 Sep 29 02:13:51.999777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 100/208] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:51 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:52.233247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:52.234287 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:52.241276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.241693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.242159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.242890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.243290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.243711 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.260258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:52.303600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:52.304350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:52.310930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.311456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.311911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.312627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.313084 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.313499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.375468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:52.383816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:52.385243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:52.386532 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-bcbdbe1e-a601-4d07-a676-343211e15204 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.159944 Sep 29 02:13:52.387087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 109/209] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:52 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:52.453022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:52.461538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eeb55a92-4061-4738-b64b-16204abc898c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.161991 Sep 29 02:13:52.462163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 101/210] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:52 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:52.640220 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:52.640961 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:52.647530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.648012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.648445 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.649139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.649584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.650037 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.789244 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:52.799105 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-db646b76-f33e-4ac4-a510-d8945223b1f3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1368 microversion: 2.1 time: 0.162644 Sep 29 02:13:52.799861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 110/211] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:52 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:52.824552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:52.825401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:52.832376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.832865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.833299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.834034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:52.834654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:52.835849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:52.975827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:52.983580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-551f04c9-d17e-453a-8acc-efba7c107e9a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.163199 Sep 29 02:13:52.984742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 102/212] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:52 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:53.022521 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:53.023126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:53.029451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.029934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.030529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.031209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.031730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.032162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.171740 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:53.181052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-25489f48-8b1d-4362-a964-50587a1e6308 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.162372 Sep 29 02:13:53.181755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 111/213] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:53 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:53.411644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:53.412300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:53.418704 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.419188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.419644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.420343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.420842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.421257 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.484861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:53.486828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:53.497517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.498249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.499500 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.500520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.502039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.502671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.601139 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:53.611054 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:53.612610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:53.613799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-943765d8-a829-4c43-882c-38470dbd2839 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.206354 Sep 29 02:13:53.614733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 103/214] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:53 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:53.667019 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:53.675257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-73fc099d-1738-4c8c-847f-57322a8808d7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.194832 Sep 29 02:13:53.675832 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 112/215] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:53 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:53.822793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:53.823518 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:53.830419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.830895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.831317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.831988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:53.832444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:53.832856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:53.970218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:53.982182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa6aa126-1e7c-4979-8b01-35336af11b4a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1556 microversion: 2.1 time: 0.163291 Sep 29 02:13:53.982776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 104/216] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:53 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:54.006292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:54.006639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:54.006755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:54.007428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:54.013294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.013778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.014076 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.014241 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.014735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.014934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.015365 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.015470 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.015891 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.016455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.017001 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.017515 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.138564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-dcdbeddf-5b05-4f93-9a08-f67c6b427709 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136493 Sep 29 02:13:54.139231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 113/217] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:13:54 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:13:54.165024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:54.175412 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50dbea77-de32-4f4c-ba44-aa170cbafea3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.172812 Sep 29 02:13:54.176196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 105/218] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:54 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:54.206077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:54.206754 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:54.214022 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.214520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.215004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.215726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.216761 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.217350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.517383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:54.525264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e9dad4ce-eb50-40ae-905d-f54810632ca6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1314 microversion: 2.1 time: 0.324709 Sep 29 02:13:54.525967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 114/219] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:54 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:54.639149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:54.639929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:54.651093 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.651657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.654205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.655118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.656472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.656915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.699634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:54.700195 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:54.703490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:54.710046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.710567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.725064 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.725885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:54.726388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:54.726824 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:54.887680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:54.897877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:54.899764 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:54.900903 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4c7f3d3a-1fca-403c-8f46-09b5e9afe854 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.266543 Sep 29 02:13:54.901928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 106/220] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:54 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:55.142107 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:55.171007 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e81eb5b3-cd2f-4cc4-906f-3ee8cb12b054 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.475215 Sep 29 02:13:55.186267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 115/221] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:54 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:55.203521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:55.204427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:55.214113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:55.214731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:55.215441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:55.216556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:55.217239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:55.217875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:55.383500 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:55.393435 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ef7277b5-6132-45d9-b3e5-c0ab996f6ffd tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.198220 Sep 29 02:13:55.394026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 107/222] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:55 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:55.551449 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:55.552085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:55.559444 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:55.560131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:55.560690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:55.561574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:55.562049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:55.562414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:55.788316 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:55.792950 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-45a31b6e-39c0-417f-987f-3ad3e597f592 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1500 microversion: 2.1 time: 0.238890 Sep 29 02:13:55.798774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 116/223] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:55 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1500 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:55.926990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:55.929027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:55.949146 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:55.951895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:55.954106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:55.957233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:55.957981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:55.958690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:56.049000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-16b7ebf2-b99f-4b4d-b363-f7604ab771ff req-18d67a37-8cb8-4453-a26f-ca99ae11725c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d6d291-847b-4e09-b49e-4c5ec0dfae6c", "tag": "d183c6c3-e338-4c72-a436-81e93d6fc258"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:56.068924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-16b7ebf2-b99f-4b4d-b363-f7604ab771ff req-18d67a37-8cb8-4453-a26f-ca99ae11725c service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:56.070689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-16b7ebf2-b99f-4b4d-b363-f7604ab771ff req-18d67a37-8cb8-4453-a26f-ca99ae11725c service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:56.071128 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-16b7ebf2-b99f-4b4d-b363-f7604ab771ff req-18d67a37-8cb8-4453-a26f-ca99ae11725c service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:56.100113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-16b7ebf2-b99f-4b4d-b363-f7604ab771ff req-18d67a37-8cb8-4453-a26f-ca99ae11725c service nova] Creating event network-changed:d183c6c3-e338-4c72-a436-81e93d6fc258 for instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c on hv-cinder-73306 Sep 29 02:13:56.111348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-16b7ebf2-b99f-4b4d-b363-f7604ab771ff req-18d67a37-8cb8-4453-a26f-ca99ae11725c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064906 Sep 29 02:13:56.114977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 117/224] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:13:56.193968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:56.195055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:56.214847 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:56.215501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:56.215956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:56.216692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:56.221411 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:56.222028 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:56.518394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:56.530986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3c578414-4a95-4867-93c1-ead1142aeb20 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.341169 Sep 29 02:13:56.535787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 118/225] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:56 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:56.545340 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:56.546210 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:56.566304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:56.567938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:56.568601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:56.569625 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:56.570502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:56.571142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:56.727327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:56.753871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:56.759637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:56.761646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-922b7ea1-a307-41c8-bb51-aa9de29d85bd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.838680 Sep 29 02:13:56.765232 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 108/226] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:55 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:56.768027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:56.785354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9b0a1b03-8911-496f-8cb6-ca0eec89cb84 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.245964 Sep 29 02:13:56.786120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 119/227] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:56 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:57.559959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:57.560751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:57.568392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:57.569093 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:57.569742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:57.570618 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:57.571379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:57.571959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:57.600472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5072e603-1245-462b-9e1b-b669d43ed16f"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:57.603126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:57.619950 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:57.620562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:57.621066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:57.621836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:57.622404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:57.622882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:57.973715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:57.982236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca1f8562-4094-416f-b6cc-33a9ffd5a0e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.427837 Sep 29 02:13:57.982768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 109/228] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:57 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:57.988829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:57.989429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:57.995828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:57.996322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:57.996760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:57.997494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:57.997948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:57.998401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:58.002898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:13:58.135717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:58.146250 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:58.148316 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:58.150450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a0aeebe-34c1-4f42-befc-b3c281770f01 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.166164 Sep 29 02:13:58.150935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 110/229] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:57 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:58.157595 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:58.158229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:58.164296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:58.164972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:58.165567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:58.166451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:58.167085 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:58.167657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:58.305654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:58.313717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b0f09510-9ade-46cc-97ad-de1861b80ba5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1321 microversion: 2.1 time: 0.161036 Sep 29 02:13:58.314319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 111/230] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:58 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:59.005313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:59.006057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:59.013448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.014241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.015822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.018206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.019371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.019993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.214493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:59.222840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-136f4571-a9fd-4bb6-9b11-e01c34bd6ee8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.221872 Sep 29 02:13:59.234028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 112/231] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:58 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:13:59.234028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:59.234028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:59.247128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.247818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.248258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.248990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.249438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.250078 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.458538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:59.467419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:59.469288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:59.470639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af40169f-135c-4f50-82ac-e745a44e96c7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.246314 Sep 29 02:13:59.472101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 113/232] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:13:59 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:13:59.476727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:59.477311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:59.484422 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.485183 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.485787 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.486492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.487077 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.487634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.624889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:13:59.633095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2a7191d-258b-4716-a19a-6ed143dd27d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1514 microversion: 2.1 time: 0.159856 Sep 29 02:13:59.633658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 114/233] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:59 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:13:59.655775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:13:59.658335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:59.664265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.664814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.665308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.666013 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.666464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.666906 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.728553 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lazy-loading 'flavor' on Instance uuid e65686a2-ff71-452b-bcfe-c81dcbf741f9 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:13:59.864671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f20e4c4-36fc-4853-a5ae-293cca0ade88 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9/action" status: 200 len: 32 microversion: 2.1 time: 0.212849 Sep 29 02:13:59.866119 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 115/234] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:13:59 2022] POST /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 29 02:13:59.875978 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:13:59.877057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:13:59.883719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.884195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.884623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:13:59.885632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:13:59.885729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:13:59.887138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:00.028299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:00.036797 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d70979a-1d48-40ac-8c48-824a39cb1a52 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.165165 Sep 29 02:14:00.037415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 116/235] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:13:59 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:14:00.247101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:00.247819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:00.254985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:00.255466 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:00.256197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:00.257100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:00.258228 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:00.258802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:00.406985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:00.416642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7e8fce1-e49c-4345-bc3b-5df27587e572 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.173133 Sep 29 02:14:00.417284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 117/236] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:00 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:00.496305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:00.497028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:00.502123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:00.504144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:00.504645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:00.505093 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:00.505871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:00.506336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:00.506763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:00.701684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:00.713703 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:00.719928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:00.721771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05b0eeae-737a-4f6a-af00-0297d922a060 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.229675 Sep 29 02:14:00.723580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 118/237] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:00 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:14:01.060684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:01.063352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:01.071444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:01.072104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:01.072722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:01.073583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:01.074074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:01.074648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:01.232715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:01.243324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45828339-3b15-40e8-9dc5-1acd7b174797 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.186777 Sep 29 02:14:01.243902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 119/238] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:01 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:01.440942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:01.441538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:01.447460 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:01.447936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:01.448542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:01.449227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:01.449743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:01.450259 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:01.687120 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:01.703275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e334385-b754-4b75-85f7-ccdc17eec853 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1362 microversion: 2.1 time: 0.266910 Sep 29 02:14:01.704211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 120/239] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:01 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:14:01.748762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:01.749360 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:01.758123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:01.758746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:01.759157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:01.759873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:01.760493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:01.761123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:01.895022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:01.903197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:01.904655 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:01.905779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b4907ac-4065-40ee-8554-3c9c61544c48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.160995 Sep 29 02:14:01.906464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 121/240] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:01 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:02.265954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:02.267336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:02.273514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:02.274017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:02.274460 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:02.275148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:02.275628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:02.276048 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:02.418218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:02.427338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-962a1442-cd4f-4a02-aedc-4a2bcd0a39e8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.165199 Sep 29 02:14:02.427908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 122/241] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:02 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:02.731024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:02.734311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:02.745033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:02.745896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:02.747173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:02.748243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:02.748997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:02.750345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.023699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-db9e3b8b-99f0-4168-91d2-07760b0a214b tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "POST /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.427327 Sep 29 02:14:03.024281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 120/242] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:13:57 2022] POST /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348/os-volume_attachments => generated 194 bytes in 5429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:14:03.035517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:03.036219 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:03.047985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:03.048617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:03.050592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.053781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:03.055130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:03.056142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.208202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:03.244825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-45cff8c6-fcdc-44af-95af-9b2608321b69 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1547 microversion: 2.1 time: 0.522437 Sep 29 02:14:03.254381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 123/243] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:02 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1547 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:14:03.277711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:03.279126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:03.304310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:03.305149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:03.306832 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.310565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:03.311343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:03.311979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.401533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:03.416420 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:03.419977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:03.421222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0ffe45a1-d25f-413f-a04b-ffad0c008b60 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.395651 Sep 29 02:14:03.421853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 121/244] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:03 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:03.463655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:03.464637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:03.472430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:03.473267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:03.473956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.474927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:03.475584 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:03.476009 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:03.698896 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:03.709356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a3aa4b88-9cde-46d2-83a5-f67d9f3f04c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.260610 Sep 29 02:14:03.710130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 122/245] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:03 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:03.855367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f75263b1-cec4-41cf-9ad7-9e86a1ede5f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.582612 Sep 29 02:14:03.856479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 124/246] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:14:03 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-interface => generated 284 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:14:04.447606 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:04.448341 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:04.455466 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:04.456333 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:04.456974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:04.457951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:04.458570 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:04.459045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:04.649363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:04.662043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:04.664273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:04.665774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d734c6cf-621d-4d74-a171-654fc54989ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.222643 Sep 29 02:14:04.666852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 123/247] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:04 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:04.733553 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:04.734432 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:04.747676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:04.749979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:04.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:04.753415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:04.754616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:04.756081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:04.773073 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:05.305249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-0d7ed8bd-3d4e-4f0d-ac55-d7e1c611207a req-72f18651-31e8-4a89-bad8-5e6feccf2683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "name": "network-vif-plugged", "status": "completed", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:05.326720 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0d7ed8bd-3d4e-4f0d-ac55-d7e1c611207a req-72f18651-31e8-4a89-bad8-5e6feccf2683 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:05.327203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0d7ed8bd-3d4e-4f0d-ac55-d7e1c611207a req-72f18651-31e8-4a89-bad8-5e6feccf2683 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:05.327628 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0d7ed8bd-3d4e-4f0d-ac55-d7e1c611207a req-72f18651-31e8-4a89-bad8-5e6feccf2683 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:05.358273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-0d7ed8bd-3d4e-4f0d-ac55-d7e1c611207a req-72f18651-31e8-4a89-bad8-5e6feccf2683 service nova] Creating event network-vif-plugged:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:14:05.364025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-0d7ed8bd-3d4e-4f0d-ac55-d7e1c611207a req-72f18651-31e8-4a89-bad8-5e6feccf2683 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065923 Sep 29 02:14:05.364943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 124/248] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:14:05.397175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:05.408803 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1e4270f-86be-40ac-b4f4-79b680fe3a19 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.679441 Sep 29 02:14:05.409486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 125/249] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:04 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:05.695275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:05.696102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:05.702439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:05.703048 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:05.703474 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:05.704811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:05.705010 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:05.705527 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:05.859842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:05.869446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:05.870822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:05.872265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-48dd9041-39da-447a-9731-0060fc52d697 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.181803 Sep 29 02:14:05.873006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 125/250] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:05 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:06.048837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5f8f2d8b-3737-49d4-9129-552811d4fa14 req-e9ac3f1e-1265-4653-9565-ee15d92b078c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122ad38e-8b7c-440d-99ab-e3c7063691ad", "tag": "870d1dee-af78-44b4-8d9b-36d459c3e5c4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:06.058437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5f8f2d8b-3737-49d4-9129-552811d4fa14 req-e9ac3f1e-1265-4653-9565-ee15d92b078c service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:06.059175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5f8f2d8b-3737-49d4-9129-552811d4fa14 req-e9ac3f1e-1265-4653-9565-ee15d92b078c service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:06.059807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5f8f2d8b-3737-49d4-9129-552811d4fa14 req-e9ac3f1e-1265-4653-9565-ee15d92b078c service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:06.071953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5f8f2d8b-3737-49d4-9129-552811d4fa14 req-e9ac3f1e-1265-4653-9565-ee15d92b078c service nova] Creating event network-changed:870d1dee-af78-44b4-8d9b-36d459c3e5c4 for instance 122ad38e-8b7c-440d-99ab-e3c7063691ad on hv-cinder-73306 Sep 29 02:14:06.077305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5f8f2d8b-3737-49d4-9129-552811d4fa14 req-e9ac3f1e-1265-4653-9565-ee15d92b078c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032403 Sep 29 02:14:06.078539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 126/251] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:14:06.433819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:06.434890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:06.442719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:06.443509 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:06.444147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:06.445338 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:06.446039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:06.446761 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:06.464475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:06.603473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:06.617185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5442f858-a9fe-43ff-8739-a4b8e3083fbe tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.186414 Sep 29 02:14:06.619971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 126/252] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:06 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:06.902176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:06.902865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:06.909959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:06.910478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:06.910894 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:06.911612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:06.912063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:06.912481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:07.049456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:07.058325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:07.059802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:07.060895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-915c1d2e-3634-4a3b-9e02-68464e47b45b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.164049 Sep 29 02:14:07.062043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 127/253] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:06 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:07.644220 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:07.644805 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:07.653045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:07.653828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:07.654454 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:07.655222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:07.656042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:07.656799 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:07.790942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:07.798964 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a0890a51-6e16-4b4f-823b-a8991a081aa7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.158841 Sep 29 02:14:07.799545 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 127/254] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:07 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:08.085884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:08.086620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:08.092718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:08.093265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:08.093697 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:08.094838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:08.095285 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:08.095740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:08.230864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:08.239720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:08.241151 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:08.242281 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a14475a1-1cdd-47b4-961f-c08dc661c54b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1406 microversion: 2.20 time: 0.160337 Sep 29 02:14:08.242845 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 128/255] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:08 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:08.821718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:08.822379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:08.830687 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:08.831167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:08.831742 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:08.832744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:08.833363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:08.833927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:08.980095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:08.988178 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0eac1a82-4ab4-4b8e-a32a-27487c070549 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.170421 Sep 29 02:14:08.988752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 128/256] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:08 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:09.269637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:09.270202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:09.276424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:09.276929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:09.277356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:09.278037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:09.278487 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:09.278890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:09.411684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:09.420029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:09.421440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:09.422604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc90dfd9-9487-47f2-8dab-d994de0fb42a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1597 microversion: 2.20 time: 0.157373 Sep 29 02:14:09.423234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 129/257] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:14:09 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1597 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:14:09.447462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:09.447950 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:09.453938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:09.454678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:09.454900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:09.455580 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:09.456026 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:09.456450 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:09.535727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e5cc914f-791d-4f8a-832b-9f607172dc8e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092160 Sep 29 02:14:09.536621 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 129/258] 10.222.0.61 () {60 vars in 1316 bytes} [Thu Sep 29 02:14:09 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:14:10.011482 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:10.012400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:10.020499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:10.020985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:10.021418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:10.022222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:10.022672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:10.023087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:10.491157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:10.503625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-811acf60-465d-4dc5-b5d1-0d4b8892e047 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.495730 Sep 29 02:14:10.504508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 130/259] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:10 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:10.828590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-51b15f17-d8dc-4d57-956a-58f04cf9de1c req-638e4567-013d-4064-ade0-f363edda4871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:10.838135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-51b15f17-d8dc-4d57-956a-58f04cf9de1c req-638e4567-013d-4064-ade0-f363edda4871 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:10.838602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-51b15f17-d8dc-4d57-956a-58f04cf9de1c req-638e4567-013d-4064-ade0-f363edda4871 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:10.839020 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-51b15f17-d8dc-4d57-956a-58f04cf9de1c req-638e4567-013d-4064-ade0-f363edda4871 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:10.850968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-51b15f17-d8dc-4d57-956a-58f04cf9de1c req-638e4567-013d-4064-ade0-f363edda4871 service nova] Creating event network-changed:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:14:10.856266 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-51b15f17-d8dc-4d57-956a-58f04cf9de1c req-638e4567-013d-4064-ade0-f363edda4871 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032134 Sep 29 02:14:10.856870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 130/260] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:14:11.532499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:11.533744 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:11.540793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:11.541277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:11.541701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:11.542420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:11.542867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:11.543256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:11.696063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:11.704061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1aa0e7fc-25eb-45d1-a996-345358d87d06 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.175996 Sep 29 02:14:11.704768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 131/261] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:11 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:12.729488 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:12.730469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:12.738812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:12.739772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:12.740413 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:12.741415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:12.742030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:12.742600 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:12.855071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:12.855613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:12.861688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:12.862218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:12.862663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:12.863341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:12.863788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:12.864430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:12.891033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:14:12.898184 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:12.913244 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c19c350e-6dcf-45eb-9fe8-19bcb2cd4578 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.188567 Sep 29 02:14:12.914308 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 131/262] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:12 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:12.984737 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad81a0a8-f95d-4d3a-9df9-602f26df2c44 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 204 len: 0 microversion: 2.1 time: 0.133254 Sep 29 02:14:12.986042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 132/263] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:14:12 2022] DELETE /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 29 02:14:12.994327 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:12.994904 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:13.001672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:13.002221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:13.002660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:13.003355 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:13.003930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:13.004476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:13.145214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:13.153579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3da9bd59-38d0-489e-98be-0e45b14c8aad tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1552 microversion: 2.1 time: 0.163175 Sep 29 02:14:13.154337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 132/264] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:12 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:13.942429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:13.942429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:13.943775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:13.944264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:13.944718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:13.945411 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:13.945843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:13.946323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:14.083860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:14.091696 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4662233b-ec97-4644-aabe-509ba3017fb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.159388 Sep 29 02:14:14.092258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 133/265] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:13 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:14.177024 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:14.177654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:14.184260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:14.184744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:14.185148 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:14.185831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:14.186304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:14.186714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:14.376254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:14.384782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f377f1bd-8e0b-446d-98a5-cb21ae1a1272 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1552 microversion: 2.1 time: 0.211905 Sep 29 02:14:14.385365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 133/266] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:14 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:15.115455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:15.115987 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:15.126139 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:15.126983 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:15.142372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:15.143235 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:15.143710 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:15.144191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:15.300247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:15.308709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b958713-0547-4bb1-ae85-f59ee185cf2e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.197504 Sep 29 02:14:15.309277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 134/267] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:15 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:15.409785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:15.410782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:15.418188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:15.418801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:15.419389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:15.420626 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:15.421310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:15.421792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:15.575388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:15.583856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-08edb45f-fb4b-436e-a835-7b966df7afe6 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1552 microversion: 2.1 time: 0.179005 Sep 29 02:14:15.584757 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 134/268] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:15 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:16.331940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:16.332637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:16.338875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:16.339463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:16.340014 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:16.340858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:16.341376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:16.341865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:16.559614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:16.567810 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5cbd9145-70af-4b8c-b9f6-e2414f692c1e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.239630 Sep 29 02:14:16.569348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 135/269] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:16 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:16.609263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:16.610632 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:16.620785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:16.622125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:16.622725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:16.623621 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:16.624068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:16.624647 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:16.659777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-df184dc4-fffb-4c02-950b-05f4f7a29367 req-cce12307-5f2d-4c31-908b-54596ae4df03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9884b6fc-bf84-48e8-8f73-b80408c9b348", "name": "network-vif-deleted", "tag": "62cb9340-38dd-43f9-a051-285ad5137842"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:16.683994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-df184dc4-fffb-4c02-950b-05f4f7a29367 req-cce12307-5f2d-4c31-908b-54596ae4df03 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:16.685037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-df184dc4-fffb-4c02-950b-05f4f7a29367 req-cce12307-5f2d-4c31-908b-54596ae4df03 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:16.685723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-df184dc4-fffb-4c02-950b-05f4f7a29367 req-cce12307-5f2d-4c31-908b-54596ae4df03 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:16.708814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-df184dc4-fffb-4c02-950b-05f4f7a29367 req-cce12307-5f2d-4c31-908b-54596ae4df03 service nova] Creating event network-vif-deleted:62cb9340-38dd-43f9-a051-285ad5137842 for instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 on hv-cinder-73306 Sep 29 02:14:16.719026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-df184dc4-fffb-4c02-950b-05f4f7a29367 req-cce12307-5f2d-4c31-908b-54596ae4df03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063126 Sep 29 02:14:16.720429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 136/270] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:14:16.721893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:16.731850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-571633e0-d093-4102-8f0c-8a87e9e4c2e9 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1510 microversion: 2.1 time: 0.127491 Sep 29 02:14:16.751938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 135/271] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:16 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:17.592592 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:17.593276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:17.600391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:17.600892 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:17.601302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:17.601993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:17.602495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:17.602916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:17.759023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:17.759632 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:17.767845 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:17.768556 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:17.769182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:17.769884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:17.770515 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:17.771114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:17.772529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:17.780682 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44a983a6-5e4b-4c34-8228-e3d9d5a1cdb5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.192350 Sep 29 02:14:17.798261 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 137/272] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:17 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:17.810319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:17.810806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:17.811237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:17.812149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lazy-loading 'fault' on Instance uuid 9884b6fc-bf84-48e8-8f73-b80408c9b348 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:14:17.858937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b624208bb94427791219ffcca0efc41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45259b9967b9410ca0fb09df7cea9f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:17.868462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-eee704de-68a8-4d48-8987-c084b7fcfb36 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 200 len: 1350 microversion: 2.1 time: 0.113302 Sep 29 02:14:17.869110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 136/273] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:17 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:14:18.809906 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:18.810506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:18.817948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:18.818557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:18.819072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:18.819840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:18.820357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:18.820774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:18.897856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:18.898376 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:18.905166 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:18.905844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:18.906292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:18.907682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:18.908236 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:18.909393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:18.928551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] HTTP exception thrown: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Request method failure captured: Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 HTTP/1.1 Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8dXPwWWsIixYvBtDHz0j7CLbkDhNKlN9uP7wbdf_vTNjHsLUTVQrBXLudLB_R2GXdh45_l5SD0qGwXVP3f36dS-fcm8LGm7IkK7SHgt28jaPT57h-XrilxWs03zCiFVHBXZSzgx1T3w_gSW7__6ucqQOplVqZ5DhQPmJht50Zk71c Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:14:18.934255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 3b624208bb94427791219ffcca0efc41 Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:18.935789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '9884b6fc-bf84-48e8-8f73-b80408c9b348'} Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:14:18.936502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:18.937947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:18.941752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Returning 404 to user: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:14:18.942856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9e00ee5e-02a6-476f-8400-94dcdb68a825 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 404 len: 111 microversion: 2.1 time: 0.052202 Sep 29 02:14:18.943434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 137/274] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:18 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:18.971573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:18.983727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-517d78e0-28ab-4c6d-86a4-41363c4c9f3f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.177690 Sep 29 02:14:18.985274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 138/275] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:18 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:19.074855 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:19.077111 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:19.085262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:19.085734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:19.086189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:19.087016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:19.087462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:19.087875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:19.101430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] HTTP exception thrown: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Request method failure captured: Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348/os-volume_attachments HTTP/1.1 Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8dXPwWWsIixYvBtDHz0j7CLbkDhNKlN9uP7wbdf_vTNjHsLUTVQrBXLudLB_R2GXdh45_l5SD0qGwXVP3f36dS-fcm8LGm7IkK7SHgt28jaPT57h-XrilxWs03zCiFVHBXZSzgx1T3w_gSW7__6ucqQOplVqZ5DhQPmJht50Zk71c Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:14:19.103583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 3b624208bb94427791219ffcca0efc41 Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:19.105018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'server_id': '9884b6fc-bf84-48e8-8f73-b80408c9b348'} Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:14:19.105802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:19.107213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:19.108541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Returning 404 to user: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:14:19.108541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c6bb4a13-d697-42b8-8ddd-ba1280f59c80 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034483 Sep 29 02:14:19.108541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 138/276] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:14:19 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:20.007492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:20.008737 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:20.015431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:20.015919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:20.016350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:20.017047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:20.017611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:20.018056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:20.157868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:20.165940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2733b37-0e82-4541-bdf7-b7dccaffcab8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.162315 Sep 29 02:14:20.166865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 139/277] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:20 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:20.345815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:20.346363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:20.353129 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:20.353602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:20.354211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:20.354955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:20.355526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:20.356394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:20.371154 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] HTTP exception thrown: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Request method failure captured: Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 HTTP/1.1 Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8dXPwWWsIixYvBtDHz0j7CLbkDhNKlN9uP7wbdf_vTNjHsLUTVQrBXLudLB_R2GXdh45_l5SD0qGwXVP3f36dS-fcm8LGm7IkK7SHgt28jaPT57h-XrilxWs03zCiFVHBXZSzgx1T3w_gSW7__6ucqQOplVqZ5DhQPmJht50Zk71c Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:14:20.372800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 3b624208bb94427791219ffcca0efc41 Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.374285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '9884b6fc-bf84-48e8-8f73-b80408c9b348'} Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:14:20.375059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.376294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.378125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Returning 404 to user: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:14:20.378125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-13556aea-618f-4238-97b8-6f9c514949c7 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 404 len: 111 microversion: 2.1 time: 0.034328 Sep 29 02:14:20.378125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 139/278] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:14:20 2022] DELETE /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:14:20.385727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:20.386476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] [instance: 9884b6fc-bf84-48e8-8f73-b80408c9b348] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:20.393092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:20.393924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:20.394378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:20.395064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:20.395669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:20.396089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:20.410386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] HTTP exception thrown: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Request method failure captured: Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 HTTP/1.1 Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8dXPwWWsIixYvBtDHz0j7CLbkDhNKlN9uP7wbdf_vTNjHsLUTVQrBXLudLB_R2GXdh45_l5SD0qGwXVP3f36dS-fcm8LGm7IkK7SHgt28jaPT57h-XrilxWs03zCiFVHBXZSzgx1T3w_gSW7__6ucqQOplVqZ5DhQPmJht50Zk71c Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:14:20.415364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45259b9967b9410ca0fb09df7cea9f15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 45259b9967b9410ca0fb09df7cea9f15 Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-DeleteServersTestJSON-50854372 Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 3b624208bb94427791219ffcca0efc41 Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-DeleteServersTestJSON-50854372-project Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.416554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '9884b6fc-bf84-48e8-8f73-b80408c9b348'} Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:14:20.417233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. Sep 29 02:14:20.418427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:14:20.419472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] Returning 404 to user: Instance 9884b6fc-bf84-48e8-8f73-b80408c9b348 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:14:20.419472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-92579e60-27c4-4353-af97-4f5b0de28833 tempest-DeleteServersTestJSON-50854372 tempest-DeleteServersTestJSON-50854372-project] 10.222.0.61 "GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348" status: 404 len: 111 microversion: 2.1 time: 0.035231 Sep 29 02:14:20.419472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 140/279] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:20 2022] GET /compute/v2.1/servers/9884b6fc-bf84-48e8-8f73-b80408c9b348 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 29 02:14:21.193164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:21.194910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:21.204407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:21.205649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:21.206617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:21.207523 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:21.208178 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:21.208742 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:21.378035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:21.388638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-10788836-9d69-4a16-a219-0c28310ca018 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.203564 Sep 29 02:14:21.391093 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 140/280] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:21 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:22.415336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:22.416559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:22.422604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:22.423079 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:22.423503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:22.424303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:22.424766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:22.425176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:22.656346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:22.664155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-03b9d39c-4c11-4a8a-b195-c57d473124e4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.252815 Sep 29 02:14:22.665303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 141/281] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:22 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:23.687406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:23.688011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:23.694993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:23.695772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:23.696392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:23.697292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:23.697924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:23.698605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:23.887652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:23.897696 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a683e89e-7621-4026-a492-b74af69d1c9b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.214015 Sep 29 02:14:23.900943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 141/282] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:23 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:24.924891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:24.925491 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:24.932150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:24.932634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:24.933121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:24.933817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:24.934324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:24.934736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:24.938900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:25.083475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:25.093420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-674b2934-743f-4d3a-8a4c-99cc89c06b80 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.172428 Sep 29 02:14:25.098057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 142/283] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:24 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:26.116751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:26.117352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:26.120662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=55 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:26.126079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:26.126749 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:26.127208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:26.127905 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:26.128335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:26.128751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:26.260686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:26.269447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fdc8a70f-8d33-44ce-be0a-df57e9054c2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.156423 Sep 29 02:14:26.270234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 142/284] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:26 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:27.292418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:27.293147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:27.299737 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:27.300293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:27.300721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:27.301409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:27.301858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:27.302310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:27.434070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:27.442802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b095b299-3ea7-4135-b93b-e1cd8423d1d8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.154322 Sep 29 02:14:27.443372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 143/285] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:27 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:28.466152 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:28.466759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:28.473240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:28.473713 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:28.474175 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:28.474848 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:28.475461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:28.475689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:28.613628 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:28.622170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c66d5266-8ae9-40ec-99db-470506bc10d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.159989 Sep 29 02:14:28.622837 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 143/286] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:28 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:29.647426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:29.648059 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:29.655372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:29.655903 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:29.656429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:29.657265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:29.657763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:29.658325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:29.793400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:29.801448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed1033d3-5fa7-42d8-8e42-9ddaf413a369 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.159627 Sep 29 02:14:29.802094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 144/287] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:29 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:30.828572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:30.829571 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:30.837497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:30.837980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:30.838502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:30.839196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:30.839650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:30.840073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:30.985812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:30.994569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8e5d3fed-aecb-44ba-911f-cf88d3c43317 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.172717 Sep 29 02:14:30.995142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 144/288] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:30 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:32.019563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:32.020179 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:32.023955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:32.027944 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:32.028420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:32.028847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:32.029533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:32.029975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:32.030413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:32.223735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:32.231767 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7e1b5a8-51e2-4946-b65c-2ed84edbfa45 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.217592 Sep 29 02:14:32.232347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 145/289] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:32 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:33.254944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:33.255868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:33.262637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:33.262980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:33.263338 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:33.264028 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:33.264471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:33.264878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:33.649475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:33.651790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:33.658947 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-eace128c-b68a-4e32-903e-c49a1e271360 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.408276 Sep 29 02:14:33.659617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 145/290] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:33 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:34.683653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:34.684265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:34.691666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:34.692252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:34.693958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:34.695240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:34.695849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:34.696419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:34.919611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:34.928844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4d7d257c-595a-458d-b19a-c03622d287cf tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.249590 Sep 29 02:14:34.929440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 146/291] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:34 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:35.952100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:35.953275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:35.961350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:35.961836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:35.962291 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:35.963168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:35.963765 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:35.964369 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:36.209450 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:36.217781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c68415ad-1f5b-469f-b899-103f64b9f620 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.269449 Sep 29 02:14:36.218620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 146/292] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:35 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:37.243197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:37.244382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:37.251086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:37.252627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:37.253273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:37.255113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:37.256153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:37.256864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:37.447314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:37.457503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8182b54c-c364-48a7-92d1-3c2d4e40a8a4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.218570 Sep 29 02:14:37.460581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 147/293] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:37 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:38.489018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:38.490278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:38.497467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:38.498123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:38.498693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:38.499535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:38.500141 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:38.500795 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:38.658183 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:38.666238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1fea4743-deeb-4ec9-b0b1-98d53e06e600 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.182401 Sep 29 02:14:38.667016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 147/294] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:38 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:39.692498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:39.693678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:39.701116 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:39.702024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:39.702639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:39.703573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:39.704178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:39.704753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:39.986937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:40.012505 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4faf2186-8e22-425c-b9c7-8690453f3ee9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.325337 Sep 29 02:14:40.013410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 148/295] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:39 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:41.037416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:41.038699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:41.056076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:41.056827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:41.057456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:41.058389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:41.059008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:41.060100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:41.374846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:41.395633 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ea43247c-21bb-46dc-bedf-055ac60fcdfa tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.362082 Sep 29 02:14:41.397535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 148/296] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:41 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:42.423910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:42.424694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:42.447842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:42.448621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:42.452760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:42.454127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:42.454804 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:42.455491 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:42.668642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:42.680794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58af3b48-f34c-4231-8ebf-c63593e30a0a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.261460 Sep 29 02:14:42.681574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 149/297] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:42 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:43.708600 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:43.709286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:43.717870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:43.718738 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:43.719811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:43.720940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:43.721907 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:43.722519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:43.993283 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:44.010409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-373f7d08-ccfd-48de-b2bc-7a46ae9e1921 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.306115 Sep 29 02:14:44.012312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 149/298] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:43 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:45.038661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:45.039380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:45.048731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:45.057354 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:45.066581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:45.070209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:45.072036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:45.074387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:45.336046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:45.349693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1acd8375-2aea-46ac-813a-246cc37d8451 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.318809 Sep 29 02:14:45.362496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 150/299] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:45 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:46.374525 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:46.375887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:46.383057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:46.383913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:46.384869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:46.385646 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:46.386126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:46.386569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:46.547303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:46.557808 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-850e0813-1b90-42fd-b007-1f55692946c4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.187395 Sep 29 02:14:46.570036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 150/300] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:46 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:47.583319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:47.583998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:47.590442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:47.591188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:47.591857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:47.592636 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:47.593307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:47.593765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:47.745646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:47.753515 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4074c05e-0c56-4232-87d1-8ea75ad74f2f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.174429 Sep 29 02:14:47.754091 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 151/301] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:47 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:48.776762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:48.777596 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:48.783942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:48.784911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:48.785705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:48.786895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:48.787560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:48.790548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:48.932649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:48.940829 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-68876638-afca-4a54-b95f-98c2e7dc88c5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.168091 Sep 29 02:14:48.941399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 151/302] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:48 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:49.965049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:49.965667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:49.975107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:49.975887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:49.976319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:49.977028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:49.977478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:49.978086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:50.135140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:50.146073 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-23bd90da-6787-4ea3-8e14-7a6d6471c396 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1520 microversion: 2.1 time: 0.184866 Sep 29 02:14:50.146698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 152/303] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:49 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:51.169702 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:51.171374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:51.185409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:51.189098 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:51.189643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:51.191660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:51.194166 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:51.195115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:51.638996 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:51.656999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0e9c3a8f-191e-4bc0-9b64-63c828fa9b4e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1500 microversion: 2.1 time: 0.491424 Sep 29 02:14:51.670734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 152/304] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:51 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1500 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:51.687915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:51.689287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:51.698416 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:51.699116 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:51.699776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:51.700684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:51.701288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:51.701856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:51.858580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:51.867329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e440b4ab-616e-4467-9d89-456e37d3c342 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1515 microversion: 2.1 time: 0.183740 Sep 29 02:14:51.867900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 153/305] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:51 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:53.613327 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:53.620242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:53.628549 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:53.640900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:53.641761 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:53.643460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:53.644165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:53.644983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:53.674693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lazy-loading 'flavor' on Instance uuid 1bcb7821-6480-46f9-a220-78d1214f7181 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:14:53.831785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5df957a3-6773-42a2-8fd3-056c11c6a17c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/action" status: 200 len: 32 microversion: 2.1 time: 0.227038 Sep 29 02:14:53.832860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 153/306] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:14:53 2022] POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/action => generated 32 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:14:53.843409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:53.844534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:53.854691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:53.855562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:53.856397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:53.857322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:53.857991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:53.858675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:54.105904 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:54.116751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c0360db-53b7-4396-b38e-89ddca73463c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.276977 Sep 29 02:14:54.117356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 154/307] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:53 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:54.787715 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-795558a2-9bd0-43b3-ba43-2af614029b25 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Action: 'create', calling method: .version_select at 0x7f404db341f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2004909055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLX7R8n6KX5G5iJPMA9KrEXdWNG2q9Ny1CR1CKD8jOIJWQlAXnFqbiAM7TxOHUXPgYUUNkXjS/Bt15+C962FMohDVhVYVNnJov4SAsWmYQGb4LiBuy5t4zqKYOXh4lFz8g=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:54.804135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-795558a2-9bd0-43b3-ba43-2af614029b25 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Getting quotas for project 30c052816d5544b38124d98d05b32798. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:14:54.807874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-795558a2-9bd0-43b3-ba43-2af614029b25 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Getting quotas for user 92d1fb3d60734f5e9bde384f96c73d30 and project 30c052816d5544b38124d98d05b32798. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:14:54.831651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-795558a2-9bd0-43b3-ba43-2af614029b25 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049288 Sep 29 02:14:54.832259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 154/308] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:14:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:14:54.938685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2142731308", "imageRef": "5ec60a69-ed9d-4b97-8e44-b4962cb1a075", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2004909055", "networks": [{"uuid": "c7c8d9a7-7400-4e7c-9e81-b91819e1ef2b"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:14:54.994264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] validate_networks() for [('c7c8d9a7-7400-4e7c-9e81-b91819e1ef2b', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:14:55.140585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:55.141317 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:55.147599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:55.148095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:55.148536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:55.149246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:55.149698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:55.150155 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:55.299762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:55.308011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-45865021-88e1-46f2-94db-d6c0bd6f89ae tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.171259 Sep 29 02:14:55.308591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 155/309] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:55 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:14:55.409617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:14:55.410019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:14:55.410498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:14:55.410920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:14:55.411566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:14:55.420465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:55.421072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:55.421506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:55.422254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:55.422687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:55.423105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:55.429783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=77 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:55.444687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Getting quotas for project 30c052816d5544b38124d98d05b32798. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:14:55.448648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Getting quotas for user 92d1fb3d60734f5e9bde384f96c73d30 and project 30c052816d5544b38124d98d05b32798. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:14:55.459920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:14:55.462582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ec60a69-ed9d-4b97-8e44-b4962cb1a075',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:14:55.515575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a117ddd-008f-48eb-aee8-b9ee4f968dbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580798 Sep 29 02:14:55.516332 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 155/310] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:14:55.527371 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-34bd7cad-b4d4-4a34-811b-d4954957208b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:55.527979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-34bd7cad-b4d4-4a34-811b-d4954957208b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:55.604716 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-34bd7cad-b4d4-4a34-811b-d4954957208b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:55.612240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-34bd7cad-b4d4-4a34-811b-d4954957208b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1259 microversion: 2.1 time: 0.088657 Sep 29 02:14:55.612959 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 156/311] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:55 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1259 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:56.332614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:56.333597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:56.339475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:56.339961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:56.340395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:56.341080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:56.341535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:56.342121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:56.479455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:56.487528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-847d50ab-7228-4ea8-8780-04ad467aa4ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.158944 Sep 29 02:14:56.488339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 156/312] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:56 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:56.636386 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:56.637179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:56.640959 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:14:56.645976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:56.646748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:56.647472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:56.648211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:56.648746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:56.649176 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:56.715372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:56.723662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8f174d7e-9133-44f3-a3d1-9cf05b1e7e5a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1263 microversion: 2.1 time: 0.091189 Sep 29 02:14:56.724235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 157/313] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:56 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1263 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:57.516274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:57.517260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:57.524975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:57.525433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:57.525891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:57.526610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:57.527196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:57.527483 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:57.746415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:57.747248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:57.754175 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:57.754863 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:57.755659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:57.756543 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:57.756995 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:57.757416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:57.799475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:57.807734 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-97ca3d2b-a0bf-4f0b-9d4b-559b73b3ec16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.298085 Sep 29 02:14:57.808297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 157/314] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:57 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:57.818047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:57.825731 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a1fe035c-141b-4d7c-9961-72b8ab16e765 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1263 microversion: 2.1 time: 0.083247 Sep 29 02:14:57.826315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 158/315] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:57 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:58.831477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:58.832028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:58.838726 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:58.839340 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:58.839766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:58.840468 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:58.840899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:58.841307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:58.849476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:58.850915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:58.857814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:58.858645 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:58.859138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:58.859830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:58.860440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:58.860957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:58.938347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:58.946608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e4d14559-3075-41a7-afcb-3ad4590e1302 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1311 microversion: 2.1 time: 0.101532 Sep 29 02:14:58.947187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 159/316] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:58 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:58.985177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:14:58.993817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1646070-701a-4125-986a-1cb2bac81059 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.166598 Sep 29 02:14:58.994407 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 158/317] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:58 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:14:59.969430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:14:59.970200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:14:59.986040 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:59.987919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:59.991708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:14:59.992721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:14:59.994659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:14:59.995586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:00.017517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:00.018563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:00.035515 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:00.038035 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:00.039315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:00.044497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:00.044929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:00.045375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:00.263034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:00.275552 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fbe0476c-b66d-41bb-b914-b0b23fe4f0a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.310606 Sep 29 02:15:00.290248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 160/318] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:14:59 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:00.362806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:00.375790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9c74729a-39ab-4e0b-bbd1-091a53c2625e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.362766 Sep 29 02:15:00.377555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 159/319] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:00 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:01.299773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:01.300460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:01.307288 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:01.307854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:01.308288 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:01.309082 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:01.309770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:01.310305 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:01.406859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:01.407565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:01.414863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:01.415455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:01.415879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:01.416588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:01.417038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:01.417630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:01.509830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:01.520590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-58d6f537-bf13-410b-a562-1e12b0205bd7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.224800 Sep 29 02:15:01.521322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 161/320] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:01 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:01.613031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:01.622685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1df02155-1d5b-48ed-b032-39ebec352440 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.221348 Sep 29 02:15:01.623469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 160/321] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:01 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:02.544050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:02.545270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:02.553985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:02.554499 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:02.554936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:02.555643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:02.556097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:02.556513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:02.572634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:02.649356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:02.650811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:02.652976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:02.660181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:02.661073 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:02.661940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:02.662957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:02.663573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:02.664157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:02.791533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:02.801477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a21f538c-3710-4a92-ac05-36c0d35c1167 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.261824 Sep 29 02:15:02.817783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 162/322] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:02 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:02.844180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:02.859365 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0e608b6-9d71-458e-95d4-a70316208b15 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.213850 Sep 29 02:15:02.861646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 161/323] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:02 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:03.829227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:03.830262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:03.841397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:03.842254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:03.842975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:03.844153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:03.844902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:03.845595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:03.884112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:03.884731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:03.891208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:03.891684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:03.892108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:03.892793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:03.893239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:03.893654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:03.980209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:03.988392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d0658155-a661-47d9-8f1b-3e9462a8215b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.165900 Sep 29 02:15:03.988973 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 163/324] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:03 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:04.021221 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:04.029260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63bc5c43-3f79-4976-b3ee-b56b613b9d01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.149077 Sep 29 02:15:04.029826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 162/325] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:03 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:05.011485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:05.012117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:05.021522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:05.022114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:05.022542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:05.023234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:05.023666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:05.024272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:05.051933 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:05.052675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:05.059714 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:05.060202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:05.060605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:05.061324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:05.061773 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:05.062232 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:05.170134 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:05.179753 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-92a8b4cc-6b1b-44db-aedb-9ee1c768e419 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.171736 Sep 29 02:15:05.180314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 164/326] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:05 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:05.218294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:05.227331 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b423d8c2-ffa8-4c81-b84e-58138a3bd9c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.179239 Sep 29 02:15:05.228197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 163/327] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:05 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:06.207546 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:06.208565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:06.212011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:06.221852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:06.222686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:06.223779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:06.224915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:06.225704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:06.226151 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:06.252531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:06.253146 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:06.254995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:06.255663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:06.262035 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:06.262520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:06.262953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:06.263646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:06.264100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:06.264519 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:06.360437 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:06.368521 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-eacf62bb-e0a9-4333-800b-f79410c78c9f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.167710 Sep 29 02:15:06.369068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 165/328] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:06 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:06.394177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:06.402650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4caa4b3-6552-4554-b07c-b1203ed68207 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.153953 Sep 29 02:15:06.403200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 164/329] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:06 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:07.391242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:07.392164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:07.400515 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:07.401412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:07.402109 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:07.403087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:07.403602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:07.404247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:07.427047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:07.427680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:07.437224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:07.438099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:07.438859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:07.439816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:07.440489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:07.441394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:07.553905 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:07.564070 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-80ee931c-cdc9-4474-9144-1291d489919f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.176522 Sep 29 02:15:07.564879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 166/330] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:07 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:07.604979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:07.613812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37f625dd-a6e3-40d1-848c-0905e494aa83 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.190508 Sep 29 02:15:07.614424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 165/331] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:07 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:08.587399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:08.588018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:08.594801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:08.595284 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:08.595705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:08.596388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:08.596828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:08.597243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:08.638106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:08.638704 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:08.645658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:08.646513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:08.647252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:08.648118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:08.648724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:08.649293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:08.733068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:08.741022 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4b5167e7-f03b-4bf2-82a9-8f4a4f9a2777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.157445 Sep 29 02:15:08.741754 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 167/332] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:08 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:08.781524 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:08.792753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7fa8389-4a41-4007-9b34-d0dec5fe3783 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.158425 Sep 29 02:15:08.793323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 166/333] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:08 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:09.764259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:09.765083 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:09.771956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:09.772448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:09.772886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:09.773591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:09.774102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:09.774535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:09.817911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:09.818672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:09.830940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:09.831438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:09.831873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:09.832577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:09.833027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:09.833448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:09.959194 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:09.971245 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-46d69fd3-1c06-4346-867b-1283125abc53 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.211094 Sep 29 02:15:09.986027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 168/334] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:09 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:10.017546 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:10.025695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-26afe79f-0a46-409f-89f3-dff68dd47251 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.211690 Sep 29 02:15:10.026334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 167/335] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:09 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:10.995862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:10.996476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:11.004622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:11.005355 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:11.006097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:11.006966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:11.007571 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:11.007995 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:11.050981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:11.052708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:11.062416 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:11.063190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:11.063847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:11.064778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:11.078810 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:11.079645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:11.183642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:11.191515 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-80432d47-b722-4fce-bdbb-1cab36c7277e tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.199756 Sep 29 02:15:11.192080 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 169/336] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:10 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:11.225069 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:11.233864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0743c007-456b-49ff-a32c-656086037ff0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.188693 Sep 29 02:15:11.234488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 168/337] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:11 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:12.214341 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:12.216070 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:12.222563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:12.222983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:12.223711 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:12.224398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:12.224840 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:12.225250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:12.264467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:12.265837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:12.277447 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:12.277941 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:12.278393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:12.279089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:12.279534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:12.279947 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:12.397143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:12.406417 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0f61bfa2-881f-4a4b-8772-3abed39f83ee tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.196431 Sep 29 02:15:12.407380 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 170/338] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:12 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:12.488057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:12.498431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a542e70c-24e4-41ee-a46d-b156ad0ec236 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.245452 Sep 29 02:15:12.499000 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 169/339] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:12 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:13.429654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:13.430316 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:13.436914 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:13.437391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:13.437812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:13.438558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:13.438999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:13.439390 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:13.523568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:13.524170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:13.534667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:13.535162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:13.535586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:13.536295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:13.536747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:13.537165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:13.573443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:13.581742 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0c407867-2a0b-443d-b312-f82b08bf869c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.156155 Sep 29 02:15:13.582332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 171/340] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:13 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:13.673673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:13.682357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de62f875-518f-45b9-b8fd-356144a83a4b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.162627 Sep 29 02:15:13.683210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 170/341] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:13 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:14.605890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:14.606709 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:14.613320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:14.613874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:14.614405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:14.615116 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:14.615647 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:14.616069 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:14.705708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:14.706390 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:14.712944 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:14.713584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:14.714033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:14.714738 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:14.715340 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:14.715765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:14.765838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:14.774186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d1d9a1bc-6229-45d1-a90c-18674eb18fa8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.172794 Sep 29 02:15:14.774851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 172/342] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:14 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:15.037106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:15.048083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8945680f-eb88-49e3-ad48-69b0cdb62dea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.347032 Sep 29 02:15:15.048959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 171/343] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:14 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:15.757854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-51ebfc1f-2fc0-4df3-824e-e2cedd2ecedc req-ecf507dd-fd00-4926-84da-e7f0b9054d44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:15.771530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-51ebfc1f-2fc0-4df3-824e-e2cedd2ecedc req-ecf507dd-fd00-4926-84da-e7f0b9054d44 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:15.772377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-51ebfc1f-2fc0-4df3-824e-e2cedd2ecedc req-ecf507dd-fd00-4926-84da-e7f0b9054d44 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:15.772872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-51ebfc1f-2fc0-4df3-824e-e2cedd2ecedc req-ecf507dd-fd00-4926-84da-e7f0b9054d44 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:15.786951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-51ebfc1f-2fc0-4df3-824e-e2cedd2ecedc req-ecf507dd-fd00-4926-84da-e7f0b9054d44 service nova] Creating event network-changed:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:15:15.793551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-51ebfc1f-2fc0-4df3-824e-e2cedd2ecedc req-ecf507dd-fd00-4926-84da-e7f0b9054d44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040895 Sep 29 02:15:15.794512 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 173/344] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:15.798259 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:15.799128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:15.805264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:15.805745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:15.806375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:15.807426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:15.808033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:15.808634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:15.825161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:16.013259 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:16.021938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-008ae178-8408-4d1a-a361-1f8f40cf3e22 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.227813 Sep 29 02:15:16.022883 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 172/345] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:15 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:16.071433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:16.072196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:16.079919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:16.080708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:16.081213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:16.082180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:16.082749 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:16.083529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:16.296046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:16.304890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2c748f1a-3f5c-4b98-b479-46203ef42ce6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.237982 Sep 29 02:15:16.305476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 174/346] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:16 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:17.047830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:17.048700 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:17.055992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:17.056469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:17.056876 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:17.058177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:17.058781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:17.059372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:17.225560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:17.236237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-72702814-1d3d-4b92-8662-bdf8ab10af4f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.193850 Sep 29 02:15:17.236879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 173/347] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:17 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:17.328200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:17.328899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:17.335493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:17.335944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:17.336366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:17.337264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:17.337710 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:17.339530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:17.492534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:17.501789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7e05323a-087e-46f4-a228-84ee82841355 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.177366 Sep 29 02:15:17.502660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 175/348] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:17 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:18.259521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:18.261818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:18.275131 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:18.275982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:18.276744 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:18.277848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:18.278370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:18.278839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:18.452125 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:18.468191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4731c0bf-5e68-4054-836f-8491c01cbe28 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.212529 Sep 29 02:15:18.468773 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 174/349] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:18 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:18.528659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:18.529239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:18.543177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:18.544452 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:18.545294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:18.545520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:18.546260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:18.546687 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:18.750668 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:18.773741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-55366555-3515-4c1e-a86e-8d61cc1bc7ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.249480 Sep 29 02:15:18.780963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 176/350] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:18 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:19.492865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:19.493439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:19.500658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:19.501147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:19.501572 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:19.502306 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:19.502745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:19.503159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:19.633311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:19.642256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5ba1f1cc-26c7-41ea-a132-b68a123745c6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.153344 Sep 29 02:15:19.642841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 175/351] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:19 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:19.806877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:19.807748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:19.815280 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:19.815773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:19.816220 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:19.816909 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:19.817359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:19.817816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:19.963124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:19.971237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f9f669b1-a685-4508-b625-0435ca833b1c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.168484 Sep 29 02:15:19.971819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 177/352] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:19 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:20.665351 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:20.666230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:20.672715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:20.673194 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:20.673622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:20.674353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:20.674799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:20.675218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:20.814598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:20.824011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fea09aea-017e-4371-81d7-df0c285a6775 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.162458 Sep 29 02:15:20.827579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 176/353] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:20 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:20.994035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:20.994929 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:21.002491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.003070 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.003570 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.004269 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.004733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.005140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.142378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:21.150233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3db20122-1585-49ca-b2f8-aaefbfc3b036 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1501 microversion: 2.1 time: 0.160244 Sep 29 02:15:21.150801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 178/354] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:20 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1501 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:21.172942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6a2cdac-4567-4230-9f57-a33ac8642095"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:21.175544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:21.181947 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.182465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.182898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.183591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.184046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.184470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.208576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] HTTP exception thrown: Cannot 'attach_volume' instance 1bcb7821-6480-46f9-a220-78d1214f7181 while it is in vm_state rescued Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Request method failure captured: Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/os-volume_attachments HTTP/1.1 Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 74 Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8lXd1WxAgFWCWk8vlemYr3D-VyoxlciJ08RNEIH8neIkGUeS_aL2mTDTexl3hDbl4KKNEbUfdJO6OvXxM-rmHcjaiyK-0yPzWW_hts6neyp5myMnzA8KviWHQT9AF51PlHwPyJcuafjKvexmb72leM3wi6Ujz8-3hhxx6vXeOkrXg Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:15:21.210725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 0df60784a8b3468ca19ec2cee1d929e5 Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {"volumeAttachment": {"volumeId": "c6a2cdac-4567-4230-9f57-a33ac8642095"}} Sep 29 02:15:21.212218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Cannot 'attach_volume' instance 1bcb7821-6480-46f9-a220-78d1214f7181 while it is in vm_state rescued Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'server_id': '1bcb7821-6480-46f9-a220-78d1214f7181', 'body': {'volumeAttachment': {'volumeId': 'c6a2cdac-4567-4230-9f57-a33ac8642095'}}} Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:15:21.213181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1bcb7821-6480-46f9-a220-78d1214f7181 while it is in vm_state rescued Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:15:21.214593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1bcb7821-6480-46f9-a220-78d1214f7181 while it is in vm_state rescued Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Returning 409 to user: Cannot 'attach_volume' instance 1bcb7821-6480-46f9-a220-78d1214f7181 while it is in vm_state rescued {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d9eefef4-690d-4d5c-a7df-3b57e1f13547 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043431 Sep 29 02:15:21.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 177/355] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:15:21 2022] POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 29 02:15:21.221609 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:21.224739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:21.229012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.229491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.229916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.230623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.231068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.231481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.263051 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:21.315778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-54c80c78-f837-4ec7-a451-98afb200563b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/action" status: 202 len: 0 microversion: 2.1 time: 0.097952 Sep 29 02:15:21.316409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 179/356] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:15:21 2022] POST /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:15:21.324965 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:21.325644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:21.332727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.333157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.333543 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.334268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.334749 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.335127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.468258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:21.477118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad195155-3021-4b83-a97f-0fd235e4e871 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1509 microversion: 2.1 time: 0.155988 Sep 29 02:15:21.477678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 178/357] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:21 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:21.849330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:21.850457 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:21.857428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.858578 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.859020 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:21.859705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:21.860146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:21.860563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:22.000160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:22.009031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-357276bb-c960-4ae1-81d8-d382144e41a9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.164693 Sep 29 02:15:22.009593 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 180/358] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:21 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:22.500871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:22.501494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:22.507513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:22.508107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:22.508535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:22.509211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:22.509700 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:22.510140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:22.657804 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:22.666634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f15942e-ce5e-492d-b765-7dd36cc320c2 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1509 microversion: 2.1 time: 0.169478 Sep 29 02:15:22.674481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 179/359] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:22 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:23.038040 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:23.038741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:23.046125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:23.046841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:23.047105 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:23.048822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:23.049759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:23.050365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:23.247094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:23.257326 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-615bce84-2cf1-4f4c-ace7-356b14febdbb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.223943 Sep 29 02:15:23.258366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 181/360] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:23 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:23.691034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:23.691818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:23.698143 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:23.698640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:23.699065 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:23.699753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:23.700195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:23.700610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:23.949937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:23.959561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-de41b909-10ad-4ab5-9981-740e97943ee3 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1509 microversion: 2.1 time: 0.272532 Sep 29 02:15:23.960568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 180/361] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:23 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:24.280915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:24.282220 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:24.289018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:24.289569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:24.290120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:24.290806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:24.291283 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:24.291756 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:24.454271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:24.463079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fdd37eaf-599d-406a-af01-c8b8c14e367c tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.185986 Sep 29 02:15:24.464121 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 182/362] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:24 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:24.983507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:24.984445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:24.990765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:24.991284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:24.991710 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:24.992537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:24.993015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:24.993449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:25.136695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:25.145488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8461be65-a7f8-40e2-b47c-d77308ecd9ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1509 microversion: 2.1 time: 0.165999 Sep 29 02:15:25.146098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 181/363] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:24 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:25.486402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:25.487007 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:25.493384 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:25.493968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:25.494423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:25.495100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:25.495542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:25.495953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:25.629389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:25.637697 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4adc526f-829d-46d9-8ed8-7ef37bd235fb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.155329 Sep 29 02:15:25.638372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 183/364] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:25 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:26.172821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:26.173509 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:26.188793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:26.189297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:26.189705 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:26.190426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:26.190893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:26.191291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:26.341816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:26.350948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6cac5a3b-e374-46f9-a968-dcbdb1c8ab7d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1509 microversion: 2.1 time: 0.182668 Sep 29 02:15:26.351641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 182/365] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:26 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:26.661328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:26.661968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:26.668708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:26.669188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:26.669620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:26.670339 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:26.670803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:26.671266 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:26.890504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:26.898685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-38c2e979-5ab3-49a1-901e-e71a309005aa tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.241277 Sep 29 02:15:26.899401 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 184/366] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:26 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:27.157824 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fc728259-a540-4723-bc0b-dcdd9f3e47ba req-91771f68-506e-46e1-8b8a-aec900e43ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "name": "network-vif-plugged", "status": "completed", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:27.169525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc728259-a540-4723-bc0b-dcdd9f3e47ba req-91771f68-506e-46e1-8b8a-aec900e43ff1 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:27.170214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc728259-a540-4723-bc0b-dcdd9f3e47ba req-91771f68-506e-46e1-8b8a-aec900e43ff1 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:27.170764 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fc728259-a540-4723-bc0b-dcdd9f3e47ba req-91771f68-506e-46e1-8b8a-aec900e43ff1 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:27.187152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fc728259-a540-4723-bc0b-dcdd9f3e47ba req-91771f68-506e-46e1-8b8a-aec900e43ff1 service nova] Creating event network-vif-plugged:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:15:27.193374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fc728259-a540-4723-bc0b-dcdd9f3e47ba req-91771f68-506e-46e1-8b8a-aec900e43ff1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039741 Sep 29 02:15:27.194039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 183/367] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:27.375457 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:27.376250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:27.378323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=56 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:27.384215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:27.385199 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:27.385640 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:27.386467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:27.386967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:27.387422 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:27.529145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:27.543032 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2b1af259-3ccd-41a8-a10f-09e5e8f494d0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1509 microversion: 2.1 time: 0.172087 Sep 29 02:15:27.543789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 185/368] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:27 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:27.922210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:27.922903 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:27.929123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:27.929608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:27.930042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:27.930719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:27.931349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:27.931953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:28.071567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:28.079751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-869904eb-e692-42d7-9b79-cc5b0f701a43 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.162008 Sep 29 02:15:28.080317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 184/369] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:27 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:28.569276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:28.570030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:28.576499 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:28.576996 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:28.577430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:28.578205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:28.578657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:28.579058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:28.729654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:28.737964 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4b079270-7efe-4bd6-ac3d-30955dbd1067 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1515 microversion: 2.1 time: 0.172744 Sep 29 02:15:28.738729 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 186/370] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:28 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:29.104361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:29.105756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:29.112128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:29.112682 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:29.113136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:29.113848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:29.114383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:29.114751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:29.249801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:29.257759 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-586017c9-fada-495a-bffe-117fbe0e2ad8 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1359 microversion: 2.1 time: 0.158186 Sep 29 02:15:29.258388 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 185/371] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:29 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:30.285319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:30.285948 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:30.292560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.293036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.293431 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.294140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.294590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.295003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.431394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:30.441353 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fd696513-71f6-464d-9c96-042981e776de tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1549 microversion: 2.1 time: 0.161730 Sep 29 02:15:30.441922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 187/372] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:30 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:30.465697 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:30.466371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:30.473400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.473891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.474353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.475534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.475842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.476263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.612496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:30.620391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfd37ddb-c5f8-42b1-b018-c9af6b1d566d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1549 microversion: 2.1 time: 0.158530 Sep 29 02:15:30.620959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 186/373] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:30 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:30.642495 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:30.647489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:30.648379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Searching by: {'deleted': False, 'project_id': '30c052816d5544b38124d98d05b32798'} {{(pid=120699) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 29 02:15:30.655631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.656113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.656668 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.657418 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.657855 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.658314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.749802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.multi_cell_list [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120699) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 29 02:15:30.843528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-61b4101f-6721-4a8a-861e-9add25516e70 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204943 Sep 29 02:15:30.844162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 188/374] 10.222.0.61 () {58 vars in 1125 bytes} [Thu Sep 29 02:15:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:30.860362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:30.860969 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:30.867155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.867631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.868057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:30.868733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:30.869175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:30.869576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:31.003750 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:31.012033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f50b1698-30f0-4a93-b5a7-41cd094e7c92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1549 microversion: 2.1 time: 0.155869 Sep 29 02:15:31.012640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 187/375] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:30 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:31.187130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-83a0e4a9-5140-4883-b2b3-953c9c24e77b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'create', calling method: .version_select at 0x7f404dcc55e0>, body: {"keypair": {"name": "tempest-keypair-721345290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhny7GKgv9vEhxEUbpO2T5PMG+NfUUgL2T1Hep/2AtJVtuvagNnRYzF334iic3VK8djbV1fkq7yMvsePg7lKRkR6gmsTLyrtmdZ6O/gzNJW+wOMKhpOMgHpZc2KQswvpg=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:31.203067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-83a0e4a9-5140-4883-b2b3-953c9c24e77b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for project 8f88658c804e40229386a559fd2a1fa9. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:15:31.207205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-83a0e4a9-5140-4883-b2b3-953c9c24e77b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for user 0df60784a8b3468ca19ec2cee1d929e5 and project 8f88658c804e40229386a559fd2a1fa9. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:15:31.232064 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-83a0e4a9-5140-4883-b2b3-953c9c24e77b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048792 Sep 29 02:15:31.232737 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 189/376] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:15:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:32.627086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-877748661", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39e5f739-8a9f-418d-a753-3adeb7a47d7a"}], "security_groups": [{"name": "tempest-securitygroup--1837745134"}], "key_name": "tempest-keypair-721345290", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:32.735099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] validate_networks() for [('39e5f739-8a9f-418d-a753-3adeb7a47d7a', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:15:32.928157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=56 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:33.123939 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:15:33.124383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:15:33.124849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:15:33.125263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:15:33.126343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:15:33.135412 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:33.135891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:33.136326 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:33.137046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:33.137494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:33.137944 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:33.157631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for project 8f88658c804e40229386a559fd2a1fa9. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:15:33.161800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Getting quotas for user 0df60784a8b3468ca19ec2cee1d929e5 and project 8f88658c804e40229386a559fd2a1fa9. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:15:33.173503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:15:33.175840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:15:33.229186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4a456710-1f77-4d9f-b5d3-c69a7aba9fc4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.606779 Sep 29 02:15:33.229830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 188/377] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:15:32 2022] POST /compute/v2.1/servers => generated 409 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 29 02:15:33.243157 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e6bb4e2c-200b-4b47-8276-6ecfcdae12ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:33.243773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e6bb4e2c-200b-4b47-8276-6ecfcdae12ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:33.304133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e6bb4e2c-200b-4b47-8276-6ecfcdae12ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:33.311620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e6bb4e2c-200b-4b47-8276-6ecfcdae12ee tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1244 microversion: 2.1 time: 0.073069 Sep 29 02:15:33.312143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 190/378] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:33 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1244 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:33.660984 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "143ae93d-8bc8-4a30-9e7a-aeb441cc265a"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:33.663662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:33.670811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:33.671290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:33.671740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:33.672462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:33.672910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:33.673325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:34.042372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:34.065231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b64b72d-e3a6-4d35-8775-eba48a2ef003 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408445 Sep 29 02:15:34.071325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 189/379] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:15:33 2022] POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:34.338849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:34.339586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:34.347131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:34.348265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:34.348925 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:34.350147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:34.350734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:34.351428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:34.420058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:34.427912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f3ce7b06-58ee-40db-88c5-9332e0cacd25 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1296 microversion: 2.1 time: 0.094749 Sep 29 02:15:34.428468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 191/380] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:34 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:35.452542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:35.453128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:35.460252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:35.461283 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:35.462688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:35.463064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:35.463719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:35.464514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:35.553584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:35.561523 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-15892be0-cc48-445b-8379-7be55f025084 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1302 microversion: 2.1 time: 0.114391 Sep 29 02:15:35.562352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 190/381] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:35 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:36.570158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-a8d58702-d8ee-44ea-8dd1-6bb0cc8ca219 req-959c9804-0e64-406b-bbd0-3b6e31ae97bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c64925-0e77-4fe1-a53f-c7104523e59d", "tag": "9dab0557-c74f-4efc-aa94-60901837db9d"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:36.586094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:36.586721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:36.594514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:36.595204 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:36.595697 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:36.596462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:36.596975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:36.597455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:36.602449 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-a8d58702-d8ee-44ea-8dd1-6bb0cc8ca219 req-959c9804-0e64-406b-bbd0-3b6e31ae97bb service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:36.605464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-a8d58702-d8ee-44ea-8dd1-6bb0cc8ca219 req-959c9804-0e64-406b-bbd0-3b6e31ae97bb service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:36.605913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-a8d58702-d8ee-44ea-8dd1-6bb0cc8ca219 req-959c9804-0e64-406b-bbd0-3b6e31ae97bb service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:36.636046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-a8d58702-d8ee-44ea-8dd1-6bb0cc8ca219 req-959c9804-0e64-406b-bbd0-3b6e31ae97bb service nova] Creating event network-changed:9dab0557-c74f-4efc-aa94-60901837db9d for instance 85c64925-0e77-4fe1-a53f-c7104523e59d on hv-cinder-73306 Sep 29 02:15:36.643359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-a8d58702-d8ee-44ea-8dd1-6bb0cc8ca219 req-959c9804-0e64-406b-bbd0-3b6e31ae97bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076697 Sep 29 02:15:36.643969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 192/382] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:36.838394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:36.847061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-74e79386-fe3b-430f-9788-bbdf7219d2a8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.264827 Sep 29 02:15:36.848027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 191/383] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:36 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:37.872861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:37.873555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:37.879898 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:37.880379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:37.880805 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:37.881495 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:37.881935 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:37.882595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:38.017290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:38.024965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-81531828-4d75-4f07-a5b1-7c0de93efddb tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.156887 Sep 29 02:15:38.025634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 193/384] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:37 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:39.050066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:39.050673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:39.059136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:39.059812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:39.060496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:39.061645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:39.062317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:39.063035 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:39.210507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:39.222347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ad23f7e3-30df-4c54-a9d8-f30b4d94022d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.177548 Sep 29 02:15:39.222930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 192/385] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:39 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:40.251110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:40.251973 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:40.260735 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:40.261226 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:40.261659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:40.262438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:40.262894 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:40.263342 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:40.401953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:40.409734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b263893f-a643-48a6-94d1-30d1d54c8275 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.167077 Sep 29 02:15:40.410525 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 194/386] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:40 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:40.424671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1572183988", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "networks": [{"uuid": "64d5cf44-44c2-485b-ba8a-a1b90eabd08f"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:40.491694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] validate_networks() for [('64d5cf44-44c2-485b-ba8a-a1b90eabd08f', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:15:40.844177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:15:40.844800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:15:40.845525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:15:40.846222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:15:40.846899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:15:40.857094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:40.857571 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:40.858030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:40.858753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:40.859198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:40.859619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:40.876650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Getting quotas for project 03571a9d7e1e43f1b5eef66eeae55844. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:15:40.881304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Getting quotas for user ffb896a1dae34a9dad20c23433855115 and project 03571a9d7e1e43f1b5eef66eeae55844. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:15:40.892548 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:15:40.895070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:15:40.943463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c825073-8052-4980-9f16-6523335c08e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522591 Sep 29 02:15:40.944099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 193/387] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:15:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:15:40.960219 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d0f3becc-8857-4325-9b2b-a9848495a3ef tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:40.961132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d0f3becc-8857-4325-9b2b-a9848495a3ef tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:40.964144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:41.017006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d0f3becc-8857-4325-9b2b-a9848495a3ef tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:41.024868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d0f3becc-8857-4325-9b2b-a9848495a3ef tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1219 microversion: 2.1 time: 0.070254 Sep 29 02:15:41.025396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 195/388] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:40 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:41.435636 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:41.436443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:41.445657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:41.446171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:41.446600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:41.447287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:41.447732 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:41.448148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:41.585972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:41.596161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6a7ca0a-f098-4ad7-bb45-13e159266008 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.165913 Sep 29 02:15:41.596846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 194/389] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:41 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:42.048533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:42.049169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:42.056439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:42.056922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:42.057358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:42.058056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:42.058544 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:42.058945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:42.125888 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:42.133842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-80fb1a70-82d7-4088-8522-ec0601b73a2e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1223 microversion: 2.1 time: 0.089286 Sep 29 02:15:42.134430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 196/390] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:42 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:42.619720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:42.620597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:42.627041 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:42.627502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:42.628161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:42.628828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:42.629276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:42.629692 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:42.762109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:42.775716 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2ae39fe4-6bb8-4138-94b5-d3ba805680f0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.159767 Sep 29 02:15:42.776307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 195/391] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:42 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:43.157233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:43.157818 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:43.167969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:43.168464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:43.168899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:43.169618 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:43.170069 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:43.170492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:43.241310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:43.249310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-13c51d74-ff2c-4f3f-b7cf-2ce947b62bf1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1215 microversion: 2.1 time: 0.096082 Sep 29 02:15:43.249916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 197/392] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:43 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:43.800280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:43.801501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:43.808534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:43.809023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:43.809452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:43.810358 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:43.810815 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:43.811238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:43.949027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:43.959640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bee97ee1-d452-4b04-8162-be0c2b611f40 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.163266 Sep 29 02:15:43.960555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 196/393] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:43 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:44.280239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:44.281138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:44.304438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:44.304929 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:44.305671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:44.306416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:44.306871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:44.307297 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:44.370109 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:44.372436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:44.379240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-74051e30-0c36-4e28-bf63-19bbacfd2651 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1215 microversion: 2.1 time: 0.105293 Sep 29 02:15:44.379833 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 198/394] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:44 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1215 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:44.943493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:44.944103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:44.950255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:44.950731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:44.951154 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:44.951843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:44.952277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:44.952688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:44.986263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:44.986872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:44.997411 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:44.997951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:44.998425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:44.999139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:44.999593 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:45.000013 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:45.085929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:45.094555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b04ee0b-be5f-4f1c-b87e-591e442e2208 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1595 microversion: 2.1 time: 0.155054 Sep 29 02:15:45.095387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 197/395] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:44 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1595 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:45.133565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:45.141271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5224e7a4-1296-4564-be1a-0197d0f683e5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.158741 Sep 29 02:15:45.141827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 199/396] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:44 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:45.402633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:45.403247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:45.409230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:45.409704 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:45.410162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:45.410842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:45.411435 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:45.412300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:45.497327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:45.509779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5aab5bac-440a-4cc8-ad24-eb99340910fe tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1271 microversion: 2.1 time: 0.110718 Sep 29 02:15:45.510953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 198/397] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:45 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:46.046047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-d29b43fa-e44c-4d8e-8827-d325f2cf9712 req-c8f5a382-9728-44e5-a2ae-dee6e63207ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c64925-0e77-4fe1-a53f-c7104523e59d", "name": "network-vif-plugged", "status": "completed", "tag": "9dab0557-c74f-4efc-aa94-60901837db9d"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:46.058104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-d29b43fa-e44c-4d8e-8827-d325f2cf9712 req-c8f5a382-9728-44e5-a2ae-dee6e63207ff service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:46.058684 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-d29b43fa-e44c-4d8e-8827-d325f2cf9712 req-c8f5a382-9728-44e5-a2ae-dee6e63207ff service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:46.059215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-d29b43fa-e44c-4d8e-8827-d325f2cf9712 req-c8f5a382-9728-44e5-a2ae-dee6e63207ff service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:46.072109 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-d29b43fa-e44c-4d8e-8827-d325f2cf9712 req-c8f5a382-9728-44e5-a2ae-dee6e63207ff service nova] Creating event network-vif-plugged:9dab0557-c74f-4efc-aa94-60901837db9d for instance 85c64925-0e77-4fe1-a53f-c7104523e59d on hv-cinder-73306 Sep 29 02:15:46.077424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-d29b43fa-e44c-4d8e-8827-d325f2cf9712 req-c8f5a382-9728-44e5-a2ae-dee6e63207ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036116 Sep 29 02:15:46.078291 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 200/398] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:46.164599 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:46.165368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:46.171986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:46.172435 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:46.173065 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:46.173754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:46.174233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:46.174649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:46.390558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:46.399020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b27a9ec6-4185-4f6f-a358-927b1801852a tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.238641 Sep 29 02:15:46.399596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 199/399] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:46 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:46.534279 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:46.535023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:46.541695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:46.542203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:46.542636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:46.543330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:46.543781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:46.544198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:46.611036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:46.619122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4964945a-fc19-42d7-8dbe-0063c19e46a5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1279 microversion: 2.1 time: 0.089239 Sep 29 02:15:46.619680 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 201/400] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:46 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:47.088913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-89873c6b-5132-4135-864d-b3fe50b9081d req-5a53550f-7b18-4930-8ba4-7b03eaa331f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:47.098298 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-89873c6b-5132-4135-864d-b3fe50b9081d req-5a53550f-7b18-4930-8ba4-7b03eaa331f1 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:47.098815 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-89873c6b-5132-4135-864d-b3fe50b9081d req-5a53550f-7b18-4930-8ba4-7b03eaa331f1 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:47.099722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-89873c6b-5132-4135-864d-b3fe50b9081d req-5a53550f-7b18-4930-8ba4-7b03eaa331f1 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:47.111831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-89873c6b-5132-4135-864d-b3fe50b9081d req-5a53550f-7b18-4930-8ba4-7b03eaa331f1 service nova] Creating event network-changed:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:15:47.118300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-89873c6b-5132-4135-864d-b3fe50b9081d req-5a53550f-7b18-4930-8ba4-7b03eaa331f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 Sep 29 02:15:47.119101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 200/401] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:15:47.424433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:47.425849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:47.433575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:47.434087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:47.434704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:47.435493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:47.436160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:47.436733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:47.599804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:47.608170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ae2cbfd0-9503-4dda-aa21-86223d64fdde tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.188125 Sep 29 02:15:47.608751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 202/402] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:47 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:47.642921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:47.643616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:47.651092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:47.651579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:47.652012 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:47.652731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:47.653195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:47.653608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:47.720819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:47.729532 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7290e98e-eab7-4f9f-8a84-c42e71abf251 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1279 microversion: 2.1 time: 0.090890 Sep 29 02:15:47.730214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 201/403] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:47 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:48.117140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1216782185"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:48.117760 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:48.123818 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.124296 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.124726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.125411 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.125863 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.126310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.261380 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.network.security_group_api [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Adding security group df4d6d47-aefe-4f19-ab95-b16b0592a626 to port 989cc0ba-4262-490c-8eed-fd84bb533af5 Sep 29 02:15:48.617302 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-970dd015-c220-49fd-8979-b3359a023360 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/action" status: 202 len: 0 microversion: 2.1 time: 0.504749 Sep 29 02:15:48.618414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 203/404] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:15:48 2022] POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:15:48.626138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:48.631304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-6b03598e-af18-4631-a471-22d6d34aa0e2 req-2b04f264-5e08-4389-add1-cbb93dbd718f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:48.637833 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:48.643952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.644569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-6b03598e-af18-4631-a471-22d6d34aa0e2 req-2b04f264-5e08-4389-add1-cbb93dbd718f service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.644675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.644772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-6b03598e-af18-4631-a471-22d6d34aa0e2 req-2b04f264-5e08-4389-add1-cbb93dbd718f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.644890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-6b03598e-af18-4631-a471-22d6d34aa0e2 req-2b04f264-5e08-4389-add1-cbb93dbd718f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.645304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.647007 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.647613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.648194 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.656718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-6b03598e-af18-4631-a471-22d6d34aa0e2 req-2b04f264-5e08-4389-add1-cbb93dbd718f service nova] Creating event network-changed:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:15:48.662033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-6b03598e-af18-4631-a471-22d6d34aa0e2 req-2b04f264-5e08-4389-add1-cbb93dbd718f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034228 Sep 29 02:15:48.663470 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 204/405] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:48.669480 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:48.670206 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:48.676381 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.676922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.677608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.678524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.678980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.679405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.797746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:48.806454 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20b0d0e8-a239-41dd-af3d-390469d57b74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1642 microversion: 2.1 time: 0.184268 Sep 29 02:15:48.806991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 202/406] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:48 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1642 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:48.810147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:48.813066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:48.814017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:48.820320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.820910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.821436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.822272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:48.822819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:48.823450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:48.826329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8e207e82-da35-40d3-a28c-74ba3c354804 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.161371 Sep 29 02:15:48.826915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 205/407] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:48 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:48.890455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:48.900153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3b1363d3-a37d-4ca2-8825-95373ac167e4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1289 microversion: 2.1 time: 0.091251 Sep 29 02:15:48.900740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 203/408] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:48 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:49.854348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:49.856262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:49.865188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:49.865349 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:49.865736 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:49.866482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:49.866948 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:49.867374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:49.923150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:49.923856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:49.930677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:49.931251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:49.931754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:49.932513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:49.933039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:49.933559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:49.998392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:50.006288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb9b0e7c-bcae-4db2-bead-8a9cd15f8393 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1277 microversion: 2.1 time: 0.087417 Sep 29 02:15:50.006614 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:50.006989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 204/409] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:49 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:50.015091 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2eeffe37-cda3-4e8c-ba53-00a0a4e9c06f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.168032 Sep 29 02:15:50.015659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 206/410] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:49 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:51.029963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:51.030615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:51.032532 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:51.033215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=12 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:51.037673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:51.038359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:51.040137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:51.040621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:51.040899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=8 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:51.041016 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:51.041731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:51.042203 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:51.042633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:51.045924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:51.046462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:51.046899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:51.047597 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:51.048050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:51.048474 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:51.188500 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:51.196955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f32afe9b-5c26-4ea6-a8ea-37a331f0b5be tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.162912 Sep 29 02:15:51.197455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 207/411] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:51 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:15:51.425437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:51.433826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1289e02a-b906-45c2-ba71-ba4d0f5d2f9c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.407760 Sep 29 02:15:51.434430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 205/412] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:51 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:52.220225 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:52.220770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:52.228554 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:52.229045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:52.229481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:52.230324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:52.230813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:52.231215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:52.255542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f9bac239-0c43-482e-b28d-26b9522d81c0 req-f8c51ecb-5e67-46f0-a7fc-05ab1f5e0b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed76a1c3-ab05-47fd-a36f-b43b032dc7f8", "tag": "1741689c-bd63-4a24-a920-8ff604b752f6"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:52.268577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9bac239-0c43-482e-b28d-26b9522d81c0 req-f8c51ecb-5e67-46f0-a7fc-05ab1f5e0b85 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:52.269394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9bac239-0c43-482e-b28d-26b9522d81c0 req-f8c51ecb-5e67-46f0-a7fc-05ab1f5e0b85 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:52.269831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f9bac239-0c43-482e-b28d-26b9522d81c0 req-f8c51ecb-5e67-46f0-a7fc-05ab1f5e0b85 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:52.286320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f9bac239-0c43-482e-b28d-26b9522d81c0 req-f8c51ecb-5e67-46f0-a7fc-05ab1f5e0b85 service nova] Creating event network-changed:1741689c-bd63-4a24-a920-8ff604b752f6 for instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 on hv-cinder-73306 Sep 29 02:15:52.291943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f9bac239-0c43-482e-b28d-26b9522d81c0 req-f8c51ecb-5e67-46f0-a7fc-05ab1f5e0b85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040444 Sep 29 02:15:52.293054 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 206/413] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:52.371391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:52.383768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b141bcc4-03ef-4145-8c6e-fdb683d9b6ac tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.166281 Sep 29 02:15:52.384553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 208/414] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:52 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:52.459374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:52.460437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:52.466941 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:52.467426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:52.467857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:52.468541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:52.468992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:52.469414 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:52.714990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:52.723401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6add1082-c646-4b2c-8f24-7a4096ab3f48 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.269712 Sep 29 02:15:52.724164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 207/415] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:52 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:53.411537 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:53.412108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:53.420037 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:53.420453 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:53.420889 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:53.421578 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:53.422036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:53.422485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:53.555490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:53.563518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-64a0cb1c-efcd-4978-8ef4-aa87ee0045f1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1370 microversion: 2.1 time: 0.155904 Sep 29 02:15:53.564097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 209/416] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:53 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:53.750484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:53.751033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:53.760086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:53.760812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:53.761474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:53.762611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:53.763282 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:53.763847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:53.767795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:53.898712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:53.906735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f174224c-2f63-4f92-87e7-1e3bb1b09bc7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.162297 Sep 29 02:15:53.907307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 208/417] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:53 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:54.586862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:54.587450 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:54.594324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:54.594786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:54.595279 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:54.595952 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:54.596409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:54.596834 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:54.732474 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:54.740601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-54f7d857-cbda-4ad4-b1ea-c8671c8469ea tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1564 microversion: 2.1 time: 0.157722 Sep 29 02:15:54.741153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 210/418] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:54 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:54.763590 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:54.764160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:54.771516 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:54.772368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:54.772816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:54.773525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:54.774153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:54.774583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:54.903904 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-44876473-9828-4d5c-8a21-97ce6a7a874c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144158 Sep 29 02:15:54.904537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 209/419] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:15:54 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:54.929088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:54.930092 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:54.936517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:54.937229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:54.937651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:54.938601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:54.939065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:54.939496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:55.216498 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:55.232735 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c4940695-8b41-4197-9820-b9be1b069b7f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.307777 Sep 29 02:15:55.233325 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 211/420] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:54 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:56.141647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0b9d307e-90a5-4c0f-9dc8-a8f9e2408b59 req-34529726-aab1-461a-aa7f-e2bdcb649b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c64925-0e77-4fe1-a53f-c7104523e59d", "tag": "9dab0557-c74f-4efc-aa94-60901837db9d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:15:56.151269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0b9d307e-90a5-4c0f-9dc8-a8f9e2408b59 req-34529726-aab1-461a-aa7f-e2bdcb649b44 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:56.151745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0b9d307e-90a5-4c0f-9dc8-a8f9e2408b59 req-34529726-aab1-461a-aa7f-e2bdcb649b44 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:56.152706 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0b9d307e-90a5-4c0f-9dc8-a8f9e2408b59 req-34529726-aab1-461a-aa7f-e2bdcb649b44 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:56.163296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0b9d307e-90a5-4c0f-9dc8-a8f9e2408b59 req-34529726-aab1-461a-aa7f-e2bdcb649b44 service nova] Creating event network-changed:9dab0557-c74f-4efc-aa94-60901837db9d for instance 85c64925-0e77-4fe1-a53f-c7104523e59d on hv-cinder-73306 Sep 29 02:15:56.168164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0b9d307e-90a5-4c0f-9dc8-a8f9e2408b59 req-34529726-aab1-461a-aa7f-e2bdcb649b44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 Sep 29 02:15:56.168756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 210/421] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:15:56.256205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:56.256770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:56.263390 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:56.263879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:56.264285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:56.264985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:56.265440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:56.265862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:56.419883 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:56.427915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6eb7bc4f-c59e-43e5-82f0-d524165deb36 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.175857 Sep 29 02:15:56.428484 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 212/422] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:56 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:57.456728 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:57.457783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:57.466580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:57.467063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:57.467496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:57.468467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:57.468930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:57.469427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:57.611458 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:57.619934 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07e1c5f3-33b3-4a73-aa0b-673981406270 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.171203 Sep 29 02:15:57.620501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 211/423] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:57 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:58.644262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:58.644878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:58.646830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:15:58.652356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:58.652836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:58.653267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:58.653955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:58.654431 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:58.654851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:58.797551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:58.809648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9e3a135a-0158-44e5-bc4a-54f4833c5851 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.169384 Sep 29 02:15:58.810280 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 213/424] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:58 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:15:59.833304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:15:59.833911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:15:59.840746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:59.841228 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:59.841652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:59.842518 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:15:59.842966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:15:59.843384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:15:59.990912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:15:59.999657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-daa66f34-da58-4e64-9b47-0f4f3e7fd8c1 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.170636 Sep 29 02:16:00.000227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 212/425] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:15:59 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:01.027734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:01.028839 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:01.040237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:01.041080 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:01.041862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:01.042706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:01.043175 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:01.043599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:01.176241 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:01.184777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a08261a8-2baa-4ed4-a86b-9b825f0b214d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.164468 Sep 29 02:16:01.185398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 214/426] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:01 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:02.207663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:02.208287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:02.215325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:02.215808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:02.216205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:02.217079 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:02.217707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:02.218272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:02.356726 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:02.364615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9aba5dd8-8056-4a43-9925-999058e13650 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.160865 Sep 29 02:16:02.365400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 213/427] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:02 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:03.387751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:03.388335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:03.395462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:03.395948 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:03.396461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:03.397150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:03.397605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:03.398100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:03.534877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:03.545363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5429780f-653f-4050-a47c-f2a5a466a59c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.161697 Sep 29 02:16:03.545928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 215/428] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:03 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:04.575181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:04.575779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:04.577789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:04.583391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:04.583878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:04.584426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:04.585109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:04.585558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:04.585953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:04.718510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:04.730510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-47dcefbc-f574-4032-89c0-f40215988d72 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.160905 Sep 29 02:16:04.731511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 214/429] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:04 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:04.910504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-75e298e0-a313-4806-91a7-7ec3533a4fac req-e788fbba-3b8e-4b1a-9539-bbc7b18babfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed76a1c3-ab05-47fd-a36f-b43b032dc7f8", "name": "network-vif-plugged", "status": "completed", "tag": "1741689c-bd63-4a24-a920-8ff604b752f6"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:16:04.920733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-75e298e0-a313-4806-91a7-7ec3533a4fac req-e788fbba-3b8e-4b1a-9539-bbc7b18babfa service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:04.921280 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-75e298e0-a313-4806-91a7-7ec3533a4fac req-e788fbba-3b8e-4b1a-9539-bbc7b18babfa service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:04.921832 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-75e298e0-a313-4806-91a7-7ec3533a4fac req-e788fbba-3b8e-4b1a-9539-bbc7b18babfa service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:04.933634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-75e298e0-a313-4806-91a7-7ec3533a4fac req-e788fbba-3b8e-4b1a-9539-bbc7b18babfa service nova] Creating event network-vif-plugged:1741689c-bd63-4a24-a920-8ff604b752f6 for instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 on hv-cinder-73306 Sep 29 02:16:04.938711 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-75e298e0-a313-4806-91a7-7ec3533a4fac req-e788fbba-3b8e-4b1a-9539-bbc7b18babfa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031906 Sep 29 02:16:04.939339 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 216/430] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:16:05.754993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:05.755561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:05.762501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:05.763088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:05.763507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:05.764258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:05.764728 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:05.765221 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:05.902363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:05.910124 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-efec57c2-9654-4e4e-a81e-b77abf2951fd tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.159324 Sep 29 02:16:05.910657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 215/431] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:05 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:06.939080 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:06.940212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:06.950031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:06.950548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:06.950983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:06.951675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:06.952104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:06.952548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:07.083424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:07.085734 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:07.092957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8c346167-f275-4edc-8e77-6e9fc9ad687a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1319 microversion: 2.1 time: 0.162193 Sep 29 02:16:07.093504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 217/432] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:06 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:08.116929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:16:08.117525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:08.124664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:08.125165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:08.125681 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:08.126448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:08.127031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:08.127475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:08.268417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:16:08.276627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c5e4989e-46a9-4d28-9f47-8e5fad957de0 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1508 microversion: 2.1 time: 0.163668 Sep 29 02:16:08.277405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 216/433] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:16:08 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:16:46.948931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f04fcb1-eb13-4a8e-a1fd-f5513418197c", "device": "/dev/sdb"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:16:46.952038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:16:46.954611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:16:46.954765 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:16:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8/os-volume_attachments (ip 10.222.0.61) !!! Sep 29 02:16:46.955843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=9 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:46.956487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:16:46.963816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:46.964298 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:46.964728 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:46.965425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:16:46.965875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:16:46.966320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:16:47.256880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3d5776bb-f261-4466-b97b-8dafb763e2a7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "POST /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311690 Sep 29 02:16:47.257510 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 218/434] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:16:46 2022] POST /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:05.322669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:05.323285 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:05.327184 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:17:05.327345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Thu Sep 29 02:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/ips (ip 10.222.0.61) !!! Sep 29 02:17:05.328413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=5 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:05.329070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=47 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:05.337990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:05.338624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:05.339225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:05.340265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:05.340733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:05.341155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:05.367799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f6a0cb95-a5a1-43f0-9449-9c23eb7b395a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/ips" status: 200 len: 148 microversion: 2.1 time: 0.050774 Sep 29 02:17:05.368276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 217/435] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:17:05 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:06.456665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:06.457880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:06.462927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:06.463497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:06.471068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:06.471579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:06.472008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:06.472693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:06.473143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:06.473560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:06.498196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-78c07834-a27c-4829-9968-9932d9d77bce tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.044165 Sep 29 02:17:06.498753 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 219/436] 10.222.0.61 () {60 vars in 1289 bytes} [Thu Sep 29 02:17:06 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:17:07.868036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d475c85-7044-4370-8014-477b28c6b3c2"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:07.870439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:07.877185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:07.877698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:07.878152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:07.878832 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:07.879297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:07.879679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:08.214656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1351e9fc-d629-41e6-a24f-a29ac1d6141a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350736 Sep 29 02:17:08.215271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 218/437] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:17:07 2022] POST /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:09.791841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:09.792445 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:09.799211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:09.799700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:09.800141 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:09.800836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:09.801296 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:09.801722 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:09.824524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lazy-loading 'flavor' on Instance uuid 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:17:10.048487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b87fb9eb-253d-407e-90e4-4d4ff36ca0a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/action" status: 202 len: 0 microversion: 2.20 time: 0.260480 Sep 29 02:17:10.049082 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 220/438] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 29 02:17:09 2022] POST /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 29 02:17:10.058815 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:10.059508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:10.066052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:10.066558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:10.066990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:10.067677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:10.068125 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:10.068557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:10.206498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:10.215949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:10.217391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:10.218573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a56844a6-29be-4dbc-a4bf-51634f62448f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.164784 Sep 29 02:17:10.219170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 219/439] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:10 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:11.246043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:11.246611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:11.254137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:11.254616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:11.255049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:11.255856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:11.256312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:11.256733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:11.398641 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:11.411295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:11.413155 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:11.414334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ae637510-af14-4dbe-91fe-5f48ccef5993 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.173295 Sep 29 02:17:11.414873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 221/440] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:11 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:12.444137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:12.445230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:12.455969 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:12.456755 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:12.457475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:12.458640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:12.459289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:12.459729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:12.590136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:12.599015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:12.600537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:12.601770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5db8876c-f6d3-4884-88f6-08d3505f1b9d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.164265 Sep 29 02:17:12.602406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 220/441] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:12 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:13.631032 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:13.631603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:13.638633 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:13.639112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:13.639552 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:13.640261 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:13.640692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:13.641110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:13.784314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:13.794180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:13.795579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:13.796761 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-72299da1-29d9-4053-9e64-6a790386bce9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.169700 Sep 29 02:17:13.797341 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 222/442] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:13 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:14.826247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:14.826920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:14.836741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:14.837220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:14.837652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:14.838380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:14.838829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:14.839252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:14.974304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:14.986122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:14.988360 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:14.990155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-08943370-4d67-48aa-bd90-68c04e432890 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.170019 Sep 29 02:17:14.990916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 221/443] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:14 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:15.513312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:15.513939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:15.521349 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:15.521890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:15.522418 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:15.523189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:15.523790 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:15.524263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:15.551958 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c6cd9016-7382-4225-9243-212ede6110e9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/ips" status: 200 len: 145 microversion: 2.1 time: 0.043031 Sep 29 02:17:15.552603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 223/444] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:17:15 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:16.019950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:16.020882 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:16.031878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:16.033152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:16.034417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:16.036392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:16.037743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:16.039181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:16.192056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:16.202664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:16.204108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:16.205250 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f763c8d1-fca8-478f-87c1-11af806730b5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.191932 Sep 29 02:17:16.205821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 222/445] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:16 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:17.239410 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:17.240337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:17.248086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:17.248569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:17.249006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:17.249693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:17.250178 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:17.250596 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:17.391994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:17.400643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:17.402088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:17.403270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-56169585-702c-4b8a-82fe-951bad34d9ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.169583 Sep 29 02:17:17.403828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 224/446] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:17 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:17.499588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:17.500067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:17.506819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:17.507295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:17.507721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:17.508476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:17.508922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:17.509340 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:17.615139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48cab060-9137-45e7-835e-315f6ffa0593"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:17.617836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:17.623832 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:17.624317 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:17.624753 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:17.625447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:17.626038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:17.626344 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:17.638357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lazy-loading 'services' on Instance uuid ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:17:17.775616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-20e02400-2293-442d-a40c-19ef3926733e tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8/os-volume_attachments/0f04fcb1-eb13-4a8e-a1fd-f5513418197c" status: 202 len: 0 microversion: 2.1 time: 0.279812 Sep 29 02:17:17.776243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 223/447] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:17:17 2022] DELETE /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8/os-volume_attachments/0f04fcb1-eb13-4a8e-a1fd-f5513418197c => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:17:17.953836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b91a2055-fdce-4668-9cd0-f087a8008b65 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342447 Sep 29 02:17:17.954506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 225/448] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:17:17 2022] POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:17:18.434403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:18.435539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:18.446120 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:18.446596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:18.447034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:18.447709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:18.448155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:18.448566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:18.585388 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:18.593919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:18.595368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:18.596512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2cad308-156f-4dfb-87a2-f0c2b38ca4d4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.169788 Sep 29 02:17:18.597067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 224/449] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:18 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:19.623768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:19.624465 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:19.632537 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:19.633029 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:19.633489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:19.634337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:19.634825 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:19.636745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:19.789598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:19.800409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:19.803299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:19.805132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c7f54bd1-ade3-4908-b3c6-bc38ce4f1ed0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.185452 Sep 29 02:17:19.805880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 226/450] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:19 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:20.836520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:20.837488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:20.845339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:20.845813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:20.846368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:20.847051 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:20.847497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:20.847913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:20.982821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:20.991033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:20.992523 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:20.993583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18709d02-bf28-450d-a7e4-ea74d69aa0f9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.163709 Sep 29 02:17:20.994155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 225/451] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:20 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:21.124724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e524e720-290e-4f66-82f6-4c5500348e9c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: .version_select at 0x7f404de2b790>, body: {"keypair": {"name": "tempest-keypair-1543949151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwGTkBz2Zspj32kDbhKqigTwlay1d7VQIoMH+ESFyyGFp2MPxqqTnckrVjf1BajH9zKl6lsBOjVaNrfAcXB4RX+//+gTHgwrrpjHA8WJOpymGmbJYNmrjsX0UaD/YzH3A=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:21.140768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-e524e720-290e-4f66-82f6-4c5500348e9c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:17:21.144558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-e524e720-290e-4f66-82f6-4c5500348e9c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:17:21.169692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e524e720-290e-4f66-82f6-4c5500348e9c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048972 Sep 29 02:17:21.170320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 227/452] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:17:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:22.018030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:22.018668 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:22.025684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:22.026199 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:22.026660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:22.027361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:22.027875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:22.028327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:22.115440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:22.115951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:22.124664 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:22.125132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:22.126234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:22.126939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:22.127416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:22.127842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:22.156797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:17:22.249523 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:22.261014 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:22.262578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:22.267366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-895eafb0-db6b-4a2e-b839-41560e71221f tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 204 len: 0 microversion: 2.1 time: 0.154281 Sep 29 02:17:22.268181 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 228/453] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:17:22 2022] DELETE /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 29 02:17:22.268974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-01eeec0a-6647-4b7b-ad18-f0ecca926f40 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.254952 Sep 29 02:17:22.269804 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 226/454] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:22 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:22.277655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:22.278630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:22.286936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:22.287430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:22.287864 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:22.288568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:22.289046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:22.289508 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:22.421071 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:22.429075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7db1950d-7ded-4100-a085-33d9565bcf1c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1514 microversion: 2.1 time: 0.156500 Sep 29 02:17:22.429653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 229/455] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:22 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:22.581708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1996947416", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21696cbf-ef5b-4f26-afb0-c5d58c71da44"}], "security_groups": [{"name": "tempest-securitygroup--146460029"}], "key_name": "tempest-keypair-1543949151", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:22.687307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] validate_networks() for [('21696cbf-ef5b-4f26-afb0-c5d58c71da44', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:17:23.076885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:17:23.077478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:17:23.077922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:17:23.078569 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:17:23.079107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:17:23.092339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:23.092793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:23.093230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:23.093952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:23.094438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:23.094858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:23.113118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:17:23.117463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:17:23.129130 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:17:23.131496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:17:23.184714 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb32ddd2-2b71-4f18-9344-bc22d6d3deda tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607265 Sep 29 02:17:23.185488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 227/456] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:17:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:17:23.197079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f9dfb5b4-bc52-44ac-87ab-8a89d0722afa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:23.197671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f9dfb5b4-bc52-44ac-87ab-8a89d0722afa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:23.255443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f9dfb5b4-bc52-44ac-87ab-8a89d0722afa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:23.262443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f9dfb5b4-bc52-44ac-87ab-8a89d0722afa tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1242 microversion: 2.1 time: 0.069246 Sep 29 02:17:23.263011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 230/457] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:23 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:23.296693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:23.297319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:23.311363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:23.311363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:23.311363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:23.311363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:23.311650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:23.311650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:23.452125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:23.452823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:23.458669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:23.459534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:23.460039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:23.460534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:23.461196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:23.461638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:23.462325 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:23.467630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:23.469052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:23.470423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86f95d2a-df14-4cf2-8799-10575a063125 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.179080 Sep 29 02:17:23.471170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 228/458] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:23 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:23.600520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:23.609512 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a78f500a-e8c4-4c6f-96ac-a44648fc666d tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1514 microversion: 2.1 time: 0.161530 Sep 29 02:17:23.610066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 231/459] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:23 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:24.288340 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:24.289258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:24.297985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:24.298490 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:24.298933 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:24.299651 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:24.300104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:24.300522 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:24.378061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:24.388754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ed551c3d-78b2-46b4-b7f5-66a2d7efbed4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1238 microversion: 2.1 time: 0.107352 Sep 29 02:17:24.389339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 229/460] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:24 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:24.505693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:24.507023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:24.519786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:24.520755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:24.521631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:24.523072 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:24.524004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:24.524867 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:24.638445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:24.639303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:24.646501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:24.647339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:24.648104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:24.649890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:24.650547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:24.651141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:24.688675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:24.698351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:24.703215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:24.704815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-49945381-cb06-4465-b83d-fc66afc71de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.208528 Sep 29 02:17:24.705377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 232/461] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:24 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:24.910485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:24.918777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-09a42fef-26fd-4d9a-b160-0cc908ceb335 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1514 microversion: 2.1 time: 0.284923 Sep 29 02:17:24.919380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 230/462] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:24 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:25.195221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-01bcd54a-ee1d-4211-9a10-4fe411240ae4 req-34bb0086-933f-4821-bd46-28ed48e3d6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed76a1c3-ab05-47fd-a36f-b43b032dc7f8", "name": "network-vif-deleted", "tag": "1741689c-bd63-4a24-a920-8ff604b752f6"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:25.205144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-01bcd54a-ee1d-4211-9a10-4fe411240ae4 req-34bb0086-933f-4821-bd46-28ed48e3d6e6 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.205610 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-01bcd54a-ee1d-4211-9a10-4fe411240ae4 req-34bb0086-933f-4821-bd46-28ed48e3d6e6 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.206240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-01bcd54a-ee1d-4211-9a10-4fe411240ae4 req-34bb0086-933f-4821-bd46-28ed48e3d6e6 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.210112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:25.217823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-01bcd54a-ee1d-4211-9a10-4fe411240ae4 req-34bb0086-933f-4821-bd46-28ed48e3d6e6 service nova] Creating event network-vif-deleted:1741689c-bd63-4a24-a920-8ff604b752f6 for instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 on hv-cinder-73306 Sep 29 02:17:25.222727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-01bcd54a-ee1d-4211-9a10-4fe411240ae4 req-34bb0086-933f-4821-bd46-28ed48e3d6e6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Sep 29 02:17:25.223454 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 233/463] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:25.416090 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:25.417036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:25.427924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.428742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.429448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.430620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.431360 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.432045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.497477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:25.505485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-68124d15-e249-4c47-be5e-f12ef3e5e02d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1294 microversion: 2.1 time: 0.096034 Sep 29 02:17:25.506036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 231/464] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:25 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:25.732243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:25.733185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:25.740167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.740650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.741082 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.741773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.742249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.742665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.886361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:25.895117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:25.896534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:25.897683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2b019b59-dfd6-40f4-953d-44e36ba8e659 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.170895 Sep 29 02:17:25.898254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 234/465] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:25 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:25.943021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:25.943794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:25.950907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.951390 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.951824 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.952557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.953044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.953467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.974601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:25.995714 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:25.996321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:25.996987 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:25.997443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lazy-loading 'fault' on Instance uuid ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:17:26.057740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:26.066479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-25423942-d2a1-452d-822f-326d40b83f34 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 200 len: 1309 microversion: 2.1 time: 0.127599 Sep 29 02:17:26.067517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 232/466] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:25 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:26.528694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:26.534062 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:26.540479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:26.540974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:26.541407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:26.542253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:26.542748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:26.543333 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:26.608122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:26.616627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6efc89f4-22a5-4e81-b1ef-cc0cbd678f7f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1300 microversion: 2.1 time: 0.092517 Sep 29 02:17:26.617212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 235/467] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:26 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:26.924257 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:26.924862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:26.931261 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:26.931740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:26.932161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:26.933263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:26.933984 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:26.934768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:27.093506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:27.094253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: ed76a1c3-ab05-47fd-a36f-b43b032dc7f8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:27.103426 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:27.104145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:27.104638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:27.105528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:27.105985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:27.106558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:27.122567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] HTTP exception thrown: Instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 could not be found. Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Request method failure captured: Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 HTTP/1.1 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP_JgcVLQnpu4G0bZ0ZQYNDM4hPgVRIJGOG9dcN7OkfvbyEHT1FxuU3rFMxLaICyfb0TYp6nvimIadDNUgtwA4v0kUrwIiFaNHBSYzdjq_A-BQK7NspZxz7_SAgmemA8LZZLgYNrePM6ve_qwHmGOlYqaFtYIabxk8k2N3w9Ur7N4n0 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 03571a9d7e1e43f1b5eef66eeae55844 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesSnapshotTestJSON-100228761 Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:17:27.124880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesSnapshotTestJSON-100228761 Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 03571a9d7e1e43f1b5eef66eeae55844 Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-100228761 Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesSnapshotTestJSON-100228761-project Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: ffb896a1dae34a9dad20c23433855115 Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesSnapshotTestJSON-100228761-project Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 could not be found. Sep 29 02:17:27.126246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': 'ed76a1c3-ab05-47fd-a36f-b43b032dc7f8'} Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 could not be found. Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:17:27.127820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 could not be found. Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 could not be found. Sep 29 02:17:27.129404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:17:27.130579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Returning 404 to user: Instance ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:17:27.130579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5fdb82a0-baa4-4873-858a-25b1997b2859 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8" status: 404 len: 111 microversion: 2.1 time: 0.040075 Sep 29 02:17:27.130579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 236/468] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:27 2022] GET /compute/v2.1/servers/ed76a1c3-ab05-47fd-a36f-b43b032dc7f8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:17:27.175493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:27.184746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:27.186113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:27.187288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e062bdcc-4aba-439f-8759-c1214f172a27 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.267134 Sep 29 02:17:27.188155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 233/469] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:26 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:27.640861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:27.641699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:27.648096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:27.648676 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:27.649212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:27.649978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:27.650536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:27.651456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:27.693343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c8ee413c-7fbd-42bd-b900-b3c8e829332a req-31d7f619-2a32-4bd8-b561-5fb6edcd03c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d17caae6-a830-4120-a14f-0f01c7d6c39d", "tag": "b456ebbb-96ea-4001-91f9-990472bb2ee7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:27.703800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c8ee413c-7fbd-42bd-b900-b3c8e829332a req-31d7f619-2a32-4bd8-b561-5fb6edcd03c7 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:27.704362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c8ee413c-7fbd-42bd-b900-b3c8e829332a req-31d7f619-2a32-4bd8-b561-5fb6edcd03c7 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:27.704970 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c8ee413c-7fbd-42bd-b900-b3c8e829332a req-31d7f619-2a32-4bd8-b561-5fb6edcd03c7 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:27.717249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c8ee413c-7fbd-42bd-b900-b3c8e829332a req-31d7f619-2a32-4bd8-b561-5fb6edcd03c7 service nova] Creating event network-changed:b456ebbb-96ea-4001-91f9-990472bb2ee7 for instance d17caae6-a830-4120-a14f-0f01c7d6c39d on hv-cinder-73306 Sep 29 02:17:27.722506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c8ee413c-7fbd-42bd-b900-b3c8e829332a req-31d7f619-2a32-4bd8-b561-5fb6edcd03c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032645 Sep 29 02:17:27.723515 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 234/470] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:17:27.796761 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:27.804566 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-34381ea4-f455-4bae-acc1-0b78e794af4d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.168377 Sep 29 02:17:27.805020 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 237/471] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:27 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:28.214966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:28.215654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:28.222294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:28.222774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:28.223203 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:28.223902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:28.224349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:28.224769 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:28.366694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:28.375423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:28.376852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:28.378034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0d4f5d13-4d7c-4e76-88b6-36fc790831dc tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.168059 Sep 29 02:17:28.378621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 235/472] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:28 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:28.829357 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:28.830075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:28.837161 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:28.837661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:28.838164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:28.838897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:28.839370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:28.839815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:28.971803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:28.979553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b46e4fe3-2840-4b0b-b69d-bd751eaf5d20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.154655 Sep 29 02:17:28.980124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 238/473] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:28 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:29.403194 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:29.404071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:29.410988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:29.411470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:29.411900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:29.412591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:29.413044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:29.413465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:29.553627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:29.562355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:29.563819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:29.564966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfe15cb2-2a04-473c-a6c8-07e14ddeed51 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.165854 Sep 29 02:17:29.565528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 236/474] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:29 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:30.007416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:30.008304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:30.019976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:30.020902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:30.021771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:30.023006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:30.023754 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:30.024489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:30.154553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:30.162864 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7c4abce2-45fb-46f4-936b-01f2b7afafdf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.162247 Sep 29 02:17:30.163432 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 239/475] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:29 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:30.591362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:30.592077 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:30.598690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:30.599163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:30.599597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:30.600273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:30.600721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:30.601155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:30.753625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:30.764551 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:30.765975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:30.767192 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5e7fa7ec-7ec9-4b03-8b14-e7a4a0aebea9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.179907 Sep 29 02:17:30.767720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 237/476] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:30 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:31.189078 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:31.189661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:31.200592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:31.201072 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:31.201504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:31.202308 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:31.202760 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:31.203180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:31.340238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:31.348531 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a56445cd-6f21-4920-bb89-fc7dc99d3e7b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.164996 Sep 29 02:17:31.349071 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 240/477] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:31 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:31.796365 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:31.796936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:31.803166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:31.803647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:31.804083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:31.804769 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:31.805227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:31.805646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:31.933727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:31.942342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:31.943765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:31.944911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e75f748d-fe60-4d4d-930b-13712b56cc9f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.154861 Sep 29 02:17:31.945468 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 238/478] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:31 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:32.376979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:32.377985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:32.388913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:32.389419 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:32.389854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:32.390582 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:32.391067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:32.391463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:32.522620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:32.530493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-16642e08-b625-4337-83ae-0db3547e9816 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.160345 Sep 29 02:17:32.531098 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 241/479] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:32 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:32.970812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:32.971493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:32.978371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:32.978858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:32.979291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:32.980006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:32.980436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:32.980858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:33.101467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:33.117779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:33.124127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:33.127260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:33.128684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:33.129836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6271fbef-78f3-482e-852f-c8a98e5f5575 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.163126 Sep 29 02:17:33.130416 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 239/480] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:32 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:33.554296 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:33.554907 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:33.556849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:33.563171 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:33.563651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:33.564082 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:33.564774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:33.565294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:33.565645 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:33.701165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:33.709164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-141a3b56-db0c-4709-9d3b-4dbf93496b7d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.158772 Sep 29 02:17:33.709724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 242/481] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:33 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:34.160295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:34.161231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:34.171449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:34.171925 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:34.172356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:34.173032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:34.173478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:34.173888 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:34.305562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:34.321528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:34.323056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:34.324156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6f70b2fe-e128-4934-b145-07ba57ac3cd3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.171425 Sep 29 02:17:34.324855 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 240/482] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:34 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:34.478657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-afda1a8a-5a11-4bd4-859e-4223db8b227b req-fc9260db-bf6a-420d-8460-9c48797ff38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "name": "network-vif-plugged", "status": "completed", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:34.489628 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-afda1a8a-5a11-4bd4-859e-4223db8b227b req-fc9260db-bf6a-420d-8460-9c48797ff38c service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:34.490210 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-afda1a8a-5a11-4bd4-859e-4223db8b227b req-fc9260db-bf6a-420d-8460-9c48797ff38c service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:34.490804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-afda1a8a-5a11-4bd4-859e-4223db8b227b req-fc9260db-bf6a-420d-8460-9c48797ff38c service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:34.502923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-afda1a8a-5a11-4bd4-859e-4223db8b227b req-fc9260db-bf6a-420d-8460-9c48797ff38c service nova] Creating event network-vif-plugged:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:17:34.508472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-afda1a8a-5a11-4bd4-859e-4223db8b227b req-fc9260db-bf6a-420d-8460-9c48797ff38c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033410 Sep 29 02:17:34.509000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 243/483] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:34.732324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:34.732939 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:34.739440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:34.739929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:34.740362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:34.741186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:34.741656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:34.742156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:34.889342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:34.898850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5fb546f4-c366-4129-9ded-d8967ad8189b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.170208 Sep 29 02:17:34.899618 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 241/484] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:34 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:35.161215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-20756597-65cb-4422-9339-728f15f612a5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:35.168050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-20756597-65cb-4422-9339-728f15f612a5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.168554 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-20756597-65cb-4422-9339-728f15f612a5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.168994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-20756597-65cb-4422-9339-728f15f612a5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:35.234352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-20756597-65cb-4422-9339-728f15f612a5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Going to try to stop instance {{(pid=120699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 29 02:17:35.281497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-20756597-65cb-4422-9339-728f15f612a5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action" status: 202 len: 0 microversion: 2.1 time: 0.125019 Sep 29 02:17:35.282127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 244/485] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:17:35 2022] POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:17:35.291098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:35.292390 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:35.300304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.301042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.301630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:35.302531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.303176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.303584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:35.352853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:35.353599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:35.360520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.361012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.361451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:35.362180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.362657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.363067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:35.463884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:35.472348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8bc3f152-40f8-4bfd-9f0f-324b596392de tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.185631 Sep 29 02:17:35.472919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 242/486] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:35 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:35.501293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:35.509414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:35.510889 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:35.512086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d5c882f3-db45-48ef-9f96-e1127840293a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.163897 Sep 29 02:17:35.512648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 245/487] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:35 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:35.925142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:35.925896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:35.927800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:35.933205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.933685 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.934138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:35.934831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:35.935410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:35.935834 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:36.139849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:36.147818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-804ff2ea-f204-4808-ad62-c7ed496beead tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.226612 Sep 29 02:17:36.148430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 243/488] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:35 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:36.501043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:36.502130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:36.505904 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:36.514850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:36.515633 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:36.516348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:36.517486 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:36.518272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:36.519013 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:36.539953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:36.541046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:36.547805 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:36.548383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:36.549296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:36.549735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:36.550287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:36.550781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:36.658652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:36.667051 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-331a101b-0a56-42fc-8e60-734dbb137121 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.172782 Sep 29 02:17:36.667623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 246/489] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:36 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:36.683940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:36.693427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:36.694809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:36.695955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dfd121d9-2f55-4443-9391-9f32a1af012e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.159996 Sep 29 02:17:36.696512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 244/490] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:36 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:37.173955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:37.174632 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:37.180852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:37.181342 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:37.181777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:37.182505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:37.182956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:37.183377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:37.333743 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:37.344906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-99f50d4a-e340-43a4-8118-cee74d1825e5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.176536 Sep 29 02:17:37.345475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 247/491] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:37 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:37.694681 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:37.695645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:37.705513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:37.705991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:37.706461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:37.707143 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:37.707589 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:37.708008 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:37.721033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:37.722966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:37.729226 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:37.729715 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:37.730188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:37.730884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:37.731350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:37.731770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:37.841484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:37.849898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fccf842b-f3f1-4669-a5ea-0460539a9ac7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.161794 Sep 29 02:17:37.850494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 245/492] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:37 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:37.861651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:37.870033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:37.871481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:37.872645 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-18adf5fa-cd4a-4e84-85cc-6c6535d020db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.155559 Sep 29 02:17:37.873201 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 248/493] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:37 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:38.372550 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:38.373546 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:38.384110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:38.384905 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:38.385615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:38.386786 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:38.387578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:38.388264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:38.526792 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:38.535657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7e930839-2a49-4db2-bf47-42183f2c1606 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.169601 Sep 29 02:17:38.536226 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 246/494] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:38 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:38.873814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:38.874539 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:38.882150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:38.882666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:38.883064 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:38.883793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:38.884242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:38.884665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:38.896992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:38.897597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:38.904330 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:38.904813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:38.905240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:38.906078 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:38.906994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:38.907733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:39.025605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:39.034533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-054c1cbc-790a-4e03-b7d6-9a4238be5b78 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.164737 Sep 29 02:17:39.035105 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 249/495] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:38 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:39.043916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:39.052271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:39.053687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:39.054863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7ad6cc0-e9b1-462d-b622-c35a16b8501b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.161862 Sep 29 02:17:39.055417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 247/496] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:38 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:39.563159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:39.563807 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:39.570383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:39.570873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:39.571314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:39.572010 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:39.572468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:39.572895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:39.706193 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:39.711194 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:39.718986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ba3c868e-fbcb-46a2-993a-a3a691c04870 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.161688 Sep 29 02:17:39.719745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 250/497] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:39 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:40.062068 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:40.063326 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:40.074436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:40.075234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:40.075956 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:40.077107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:40.077863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:40.078711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:40.083469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:40.084108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:40.091555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:40.092050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:40.092483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:40.093169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:40.093808 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:40.094102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:40.212760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:40.221305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-045b08ef-51ca-4355-9f24-6d260658a166 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.165627 Sep 29 02:17:40.221881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 248/498] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:40 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:40.227353 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:40.236003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:40.237430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:40.238613 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-86bbffd7-0377-4acd-a13f-a3295c539e1a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.159917 Sep 29 02:17:40.239122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 251/499] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:40 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:40.747013 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:40.748013 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:40.758224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:40.759021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:40.759738 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:40.760871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:40.761625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:40.762376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:40.782484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:40.911328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:40.919123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3cb4afc2-fffa-49e1-960a-6e26991f922e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.178803 Sep 29 02:17:40.919659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 249/500] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:40 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:41.247003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:41.247708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:41.255492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:41.255974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:41.256408 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:41.257095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:41.257542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:41.257960 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:41.264057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:41.264724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:41.271638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:41.272117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:41.272542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:41.273342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:41.273808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:41.274247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:41.391149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:41.399893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-514d6e51-bd9e-424f-8e33-76884eaf55e1 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.158296 Sep 29 02:17:41.400467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 252/501] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:41 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:41.412956 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:41.421022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:41.422497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:41.423840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-727838bd-89c0-4fa8-8fa3-aa96fa236bc2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.163695 Sep 29 02:17:41.424393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 250/502] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:41 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:41.953421 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:41.954517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:41.964759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:41.965507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:41.966313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:41.967501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:41.968259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:41.968963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.105673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:42.114644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-63991ca8-e7f3-4c34-b5cb-87227ada7d43 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.167933 Sep 29 02:17:42.115253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 253/503] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:41 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:42.290463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2043183585", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "networks": [{"uuid": "64d5cf44-44c2-485b-ba8a-a1b90eabd08f"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:42.344096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] validate_networks() for [('64d5cf44-44c2-485b-ba8a-a1b90eabd08f', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:17:42.423940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:42.424553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:42.431359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:42.431844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:42.432277 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.432968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:42.433470 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:42.433897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.566737 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:42.575256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a21876f2-7110-47be-91b7-922bbbc01478 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.155529 Sep 29 02:17:42.575819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 254/504] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:42 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:42.580464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:42.581077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:42.586908 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:42.587401 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:42.587844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.588544 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:42.589002 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:42.589427 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.707199 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:17:42.707622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:17:42.708095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:17:42.708502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:17:42.708913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:17:42.718136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:42.718611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:42.719040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.719759 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:42.720544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:42.721084 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:42.722423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:42.730982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:42.732328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:42.733897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-264d0fa0-e945-46b6-a356-b324df173bd0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1743 microversion: 2.20 time: 0.156795 Sep 29 02:17:42.734492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 255/505] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:42 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:42.739263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Getting quotas for project 03571a9d7e1e43f1b5eef66eeae55844. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:17:42.743304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Getting quotas for user ffb896a1dae34a9dad20c23433855115 and project 03571a9d7e1e43f1b5eef66eeae55844. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:17:42.756530 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:17:42.758949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:17:42.806688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e102db80-b4aa-41ea-9dba-9866fd156ee8 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520725 Sep 29 02:17:42.807299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 251/506] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:17:42.818634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d74166bc-e786-4a79-be56-b7539bc35c63 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:42.819248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d74166bc-e786-4a79-be56-b7539bc35c63 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:42.872079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d74166bc-e786-4a79-be56-b7539bc35c63 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:42.879310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d74166bc-e786-4a79-be56-b7539bc35c63 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1219 microversion: 2.1 time: 0.064592 Sep 29 02:17:42.879870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 256/507] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:42 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:43.258720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:43.259324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:43.265994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.266509 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.266975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.267835 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.268286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.268707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.403927 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:43.411742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4732f06f-1533-4d67-b006-6101ea805cea tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.277481 Sep 29 02:17:43.412274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 252/508] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:43 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:43.603572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:43.604439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:43.615032 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.615583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.616025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.616722 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.617175 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.617601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.759660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:43.760555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:43.761352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:43.766979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.767794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.768453 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.769231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.769756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.770272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.774292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-534c2b1e-c20f-4003-9214-0acfc8a76459 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.174689 Sep 29 02:17:43.774924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 257/509] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:43 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:43.903609 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:43.904231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:43.911333 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.911819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.912438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.913187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:43.913646 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:43.914254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:43.919595 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:43.929848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:43.931367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:43.932713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1b446d7f-0dbb-40d8-a176-3b7f3dbc5eec tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.177235 Sep 29 02:17:43.933268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 253/510] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:43 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:43.975805 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:43.984059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-de199368-8bcb-4d5d-bb87-2bdfe51ac8bf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1215 microversion: 2.1 time: 0.084133 Sep 29 02:17:43.984625 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 258/511] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:43 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:44.437943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:44.439409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:44.447430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:44.448488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:44.448916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:44.449615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:44.450248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:44.450816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:44.647741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:44.663536 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5f50f967-e92b-4a10-8997-0a4e60bf5acb tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.232097 Sep 29 02:17:44.664380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 254/512] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:44 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:44.799297 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:44.801243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:44.808302 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:44.809005 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:44.809425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:44.810148 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:44.810596 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:44.811017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:44.954652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:44.958778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:44.959391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:44.964528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-249c1691-a2b8-4210-925e-9f2f8b8f5e58 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.169184 Sep 29 02:17:44.965136 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 259/513] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:44 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:44.966414 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:44.966914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:44.967350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:44.968053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:44.968507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:44.968931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:45.007351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:45.007974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:45.014323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:45.014822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:45.015263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:45.015993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:45.016492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:45.016921 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:45.103041 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:45.114631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-68bff4b4-7ebd-4809-862d-7d85e57b19d3 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1215 microversion: 2.1 time: 0.111111 Sep 29 02:17:45.116021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 260/514] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:45 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:45.172822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:45.181912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:45.184388 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:45.185775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c849bd3-7573-45a9-8965-fbbe420c7af1 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.231170 Sep 29 02:17:45.186746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 255/515] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:44 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:45.687719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:45.688332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:45.694845 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:45.695335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:45.695767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:45.696467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:45.696922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:45.697314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:45.833204 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:45.842315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6d63d8a7-8de4-420e-abd4-b3fa275bf9be tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.158513 Sep 29 02:17:45.858634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 261/516] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:45 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:46.119501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:46.121763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:46.128895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.129825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.130445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.131774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.132395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.132988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.138447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:46.139319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:46.149572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.152313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.152951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.153870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.155780 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.156440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.226920 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:46.248136 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d22665ea-a83b-4992-8626-58be2e605c65 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1279 microversion: 2.1 time: 0.113696 Sep 29 02:17:46.254375 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 262/517] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:46 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:46.259502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:46.260115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:46.274104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.274612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.275065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.275773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.276234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.276661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.428022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:46.443463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8b24ae0-bf15-4ff6-8e31-aa79cef7e6f0 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.457624 Sep 29 02:17:46.446698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 256/518] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:45 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:46.459728 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:46.477213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:46.478670 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:46.486189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3dfd3005-d259-4047-ab1e-e625c3fe6413 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.230390 Sep 29 02:17:46.487094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 263/519] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:46 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:46.867835 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:46.868753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:46.879938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.884519 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.885225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.886237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.886852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.888986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:46.968202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-2174b85b-e49e-4b61-b896-bd6d19159889 req-4ad7b137-f1e7-41ea-a81b-b5d6e1021fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d17caae6-a830-4120-a14f-0f01c7d6c39d", "name": "network-vif-plugged", "status": "completed", "tag": "b456ebbb-96ea-4001-91f9-990472bb2ee7"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:46.987841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-2174b85b-e49e-4b61-b896-bd6d19159889 req-4ad7b137-f1e7-41ea-a81b-b5d6e1021fa4 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:46.988807 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-2174b85b-e49e-4b61-b896-bd6d19159889 req-4ad7b137-f1e7-41ea-a81b-b5d6e1021fa4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:46.989420 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-2174b85b-e49e-4b61-b896-bd6d19159889 req-4ad7b137-f1e7-41ea-a81b-b5d6e1021fa4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.004900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-2174b85b-e49e-4b61-b896-bd6d19159889 req-4ad7b137-f1e7-41ea-a81b-b5d6e1021fa4 service nova] Creating event network-vif-plugged:b456ebbb-96ea-4001-91f9-990472bb2ee7 for instance d17caae6-a830-4120-a14f-0f01c7d6c39d on hv-cinder-73306 Sep 29 02:17:47.011043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-2174b85b-e49e-4b61-b896-bd6d19159889 req-4ad7b137-f1e7-41ea-a81b-b5d6e1021fa4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046647 Sep 29 02:17:47.012549 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 264/520] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:17:47.277906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:47.278948 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:47.287152 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:47.287973 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:47.288572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.289617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:47.290323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:47.290933 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.516232 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:47.530734 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31f83ba5-8152-4643-90fa-087e8cc66341 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.666690 Sep 29 02:17:47.537789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 257/521] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:46 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:47.537789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:47.537789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:47.555181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:47.555677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:47.556114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.556813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:47.557447 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:47.558049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.559663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:47.573513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fa677c28-2139-405b-9e50-64060e184df4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.300184 Sep 29 02:17:47.586027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 265/522] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:47 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:47.586027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:47.586027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:47.592540 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:47.594248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:47.594985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.595945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:47.596706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:47.597456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:47.761662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:47.761855 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:47.770597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8b38f685-3704-4b0a-a152-83ea5e5af0a9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.237830 Sep 29 02:17:47.771511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:47.772095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 258/523] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:47 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:47.772963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:47.774355 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-88ae766d-3db0-4f43-9fc9-58e12c36ba38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.197870 Sep 29 02:17:47.791880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 266/524] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:47 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:48.557642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:48.559468 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:48.568717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.569503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.570397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.571303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.571916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.572501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.603431 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:48.604247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:48.616937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.617432 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.617875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.618616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.619072 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.619502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.764147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:48.772816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-867c887b-0fbc-4881-8049-b019092a093c tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.175819 Sep 29 02:17:48.773435 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 267/525] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:48 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:48.797918 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:48.798788 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:48.805382 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.805884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.806366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.807085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.807543 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.807968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.866242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:48.874485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59400618-8ca7-4445-b65d-2f8f93dd41ed tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.322977 Sep 29 02:17:48.875501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 259/526] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:48 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:48.880643 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:48.882674 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:48.890150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.890986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.891642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.892620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:48.893207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:48.893733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:48.990988 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:49.005162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0ff77972-e540-433e-9b87-422a8015e179 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.212065 Sep 29 02:17:49.006417 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 268/527] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:48 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:49.122412 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:49.144690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:49.147562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:49.149437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b8d049b-921d-436c-ad3a-15700a7ea611 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.272640 Sep 29 02:17:49.150347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 260/528] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:48 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:49.623554 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-1e2f7429-0759-4947-a7bf-266a8a02bd3e req-fc9b88ea-9236-4785-872d-95b27a71c747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3cc888-a13a-432f-b4c8-a6e268c10910", "tag": "24c56e8e-5743-4f19-bd53-651a3880405f"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:49.635496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-1e2f7429-0759-4947-a7bf-266a8a02bd3e req-fc9b88ea-9236-4785-872d-95b27a71c747 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:49.636268 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-1e2f7429-0759-4947-a7bf-266a8a02bd3e req-fc9b88ea-9236-4785-872d-95b27a71c747 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:49.636944 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-1e2f7429-0759-4947-a7bf-266a8a02bd3e req-fc9b88ea-9236-4785-872d-95b27a71c747 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:49.641306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:49.651009 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-1e2f7429-0759-4947-a7bf-266a8a02bd3e req-fc9b88ea-9236-4785-872d-95b27a71c747 service nova] Creating event network-changed:24c56e8e-5743-4f19-bd53-651a3880405f for instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 on hv-cinder-73306 Sep 29 02:17:49.656091 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-1e2f7429-0759-4947-a7bf-266a8a02bd3e req-fc9b88ea-9236-4785-872d-95b27a71c747 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036982 Sep 29 02:17:49.657024 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 269/529] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:49.797550 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:49.798925 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:49.806500 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:49.807372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:49.808080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:49.808945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:49.809669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:49.810279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:49.900773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:49.902073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:49.908759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:49.909619 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:49.910406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:49.911525 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:49.912458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:49.913090 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:50.000544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:50.013300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2a1f6145-2c06-449e-92c4-5ed3af4d9369 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.220355 Sep 29 02:17:50.014470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 261/530] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:49 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:50.030794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:50.034721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:50.042771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:50.043544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:50.044163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:50.045029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:50.045639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:50.046247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:50.087118 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:50.096895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-62568087-52bb-4e96-8637-617eb09956b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1367 microversion: 2.1 time: 0.200327 Sep 29 02:17:50.114668 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 270/531] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:49 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:50.176901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:50.178017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:50.185144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:50.186043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:50.186733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:50.187899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:50.188660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:50.189299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:50.326540 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:50.338566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-876a5f95-1ae1-4bfd-8a2b-c142addfa1e3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1722 microversion: 2.1 time: 0.312593 Sep 29 02:17:50.339148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 262/532] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:50 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:50.357975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:50.366919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:50.368354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:50.369540 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5a958f35-fc1c-4948-9cda-f7d3a818bdca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.197824 Sep 29 02:17:50.370295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 271/533] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:50 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:51.037779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:51.038609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:51.051329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.052474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.053429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.055376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.056972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.058186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.120866 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:51.121677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:51.135027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.135595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.136042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.136776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.137292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.137726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.317483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:51.327081 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9bc5fc7f-06be-4195-a0f8-e92ac9aa778c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1555 microversion: 2.1 time: 0.210005 Sep 29 02:17:51.342859 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 272/534] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:51 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:51.353098 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:51.353688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:51.361363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.361709 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.362400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.364365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.364911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.365499 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.547228 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-14639a4c-717f-4441-8ec1-255ab5db4e9b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199273 Sep 29 02:17:51.571953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 273/535] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:17:51 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/os-interface => generated 284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:17:51.594311 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:51.595823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:51.621572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.631479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.632392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.633173 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.633653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.634107 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.658459 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:51.669961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb035a1d-6378-4ccb-9c7f-fdbb3cd16063 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.636410 Sep 29 02:17:51.671852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 263/536] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:51 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:51.679926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:51.683358 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:51.700579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.702037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.702657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.703535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:51.704157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:51.704582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:51.854096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:51.866581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:51.868282 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:51.871593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-806af9e7-5f81-4353-997f-fd567d864772 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.195735 Sep 29 02:17:51.872086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 264/537] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:51 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:52.021125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:52.041446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4cbf7895-9433-46bc-8de0-ae02d855b9af tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1699 microversion: 2.1 time: 0.467904 Sep 29 02:17:52.043894 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 274/538] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:51 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1699 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:52.067937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c229fffb-a448-4efa-871a-2af7400e21fe tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:52.075072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c229fffb-a448-4efa-871a-2af7400e21fe tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.075919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c229fffb-a448-4efa-871a-2af7400e21fe tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.076525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c229fffb-a448-4efa-871a-2af7400e21fe tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:52.153634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c229fffb-a448-4efa-871a-2af7400e21fe tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Going to try to start instance {{(pid=120698) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 29 02:17:52.214398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:52.229463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c229fffb-a448-4efa-871a-2af7400e21fe tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action" status: 202 len: 0 microversion: 2.1 time: 0.165836 Sep 29 02:17:52.230088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 265/539] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:17:52 2022] POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:17:52.242598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:52.243890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:52.259964 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.260464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.261114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:52.261846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.262340 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.262839 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:52.703131 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:52.704092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:52.715334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.715831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.716274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:52.717647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.718132 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.718562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:52.757091 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:52.767284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:52.876307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:17:52.914762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:52.923423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7082fbe3-4fc5-4a49-a95a-da93fffd8aeb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.230102 Sep 29 02:17:52.927015 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:52.935764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2ce8c6f0-bd63-4fb6-81ac-b5642e0f1513 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1708 microversion: 2.1 time: 0.700034 Sep 29 02:17:52.936350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 275/540] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:52 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1708 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:52.936902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 266/541] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:52 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:52.946086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:52.946919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:52.953479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.954202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.954807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:52.955666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:52.956274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:52.957017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:53.102595 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:53.112082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:53.113556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:53.114991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af63550c-b514-41fe-bfcc-ff133459a157 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.176827 Sep 29 02:17:53.115564 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 267/542] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:52 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:53.248887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-644d053f-d2af-4776-8445-b76d55ef3b19 req-14197582-60b0-45c6-88b4-bb7557b4aac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d17caae6-a830-4120-a14f-0f01c7d6c39d", "tag": "b456ebbb-96ea-4001-91f9-990472bb2ee7"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:53.264244 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-644d053f-d2af-4776-8445-b76d55ef3b19 req-14197582-60b0-45c6-88b4-bb7557b4aac3 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:53.264710 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-644d053f-d2af-4776-8445-b76d55ef3b19 req-14197582-60b0-45c6-88b4-bb7557b4aac3 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:53.265142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-644d053f-d2af-4776-8445-b76d55ef3b19 req-14197582-60b0-45c6-88b4-bb7557b4aac3 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:53.285799 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-644d053f-d2af-4776-8445-b76d55ef3b19 req-14197582-60b0-45c6-88b4-bb7557b4aac3 service nova] Creating event network-changed:b456ebbb-96ea-4001-91f9-990472bb2ee7 for instance d17caae6-a830-4120-a14f-0f01c7d6c39d on hv-cinder-73306 Sep 29 02:17:53.294576 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-644d053f-d2af-4776-8445-b76d55ef3b19 req-14197582-60b0-45c6-88b4-bb7557b4aac3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049233 Sep 29 02:17:53.296286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 276/543] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:53.977567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:53.978382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:53.979441 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:53.984861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:54.001384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:54.005297 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:54.005764 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:54.006304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:54.007081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:54.007658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:54.008865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:54.015408 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:54.017016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:54.017841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:54.018637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:54.019262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:54.227328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:54.231587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:54.240642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2e40144e-ac0a-43b1-887c-41526cbb70f5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1708 microversion: 2.1 time: 0.279995 Sep 29 02:17:54.240820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9b6c16b6-0e01-4ffd-8c31-d4a4da1601d6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.285043 Sep 29 02:17:54.241620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 268/544] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:53 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:54.255905 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 277/545] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:53 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1708 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:54.392485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:54.393427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:54.400115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:54.400846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:54.401465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:54.402214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:54.402673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:54.403090 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:54.575895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:54.586958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:54.588579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:54.589915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b1e7c9e9-588a-4f0b-9b2a-675a85ee369f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.347338 Sep 29 02:17:54.590501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 269/546] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:54 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:55.266335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:55.267228 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:55.274501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:55.275365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:55.276033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:55.276816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:55.277509 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:55.278166 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:55.279531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:55.280481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:55.288041 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:55.288808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:55.289254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:55.289889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:55.290420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:55.290775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:55.447432 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:55.452643 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:55.462247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-911c2871-9ad6-4c9f-ad40-94c6cf9a1a29 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.199958 Sep 29 02:17:55.462565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd87d888-383a-466c-bd94-7e52153bee4d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1708 microversion: 2.1 time: 0.186960 Sep 29 02:17:55.463584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 270/547] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:55 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1708 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:55.475289 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 278/548] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:55 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:55.615415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:55.616026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:55.622706 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:55.623197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:55.623633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:55.624343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:55.624796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:55.625193 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:55.783642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:55.795682 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:55.797352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:55.798747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4ddbf73e-a6df-43c8-8212-3166cdeb2abb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.187484 Sep 29 02:17:55.799820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 271/549] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:55 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:56.486391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:56.486979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:56.491608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:56.492217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:56.494334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:56.494830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:56.495272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:56.495961 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:56.496582 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:56.497031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:56.499001 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:56.499556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:56.499913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:56.500598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:56.502373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:56.502373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:56.630730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:56.638703 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-40d5169b-18d3-4e5e-8ccf-cb0e98ed4ea5 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.157623 Sep 29 02:17:56.639332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 279/550] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:56 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:56.825144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:56.825787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:56.832347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:56.832839 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:56.833329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:56.834041 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:56.834554 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:56.834919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:56.859166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:56.868413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5236f023-cec0-47f5-8988-f74937850bba tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1708 microversion: 2.1 time: 0.382958 Sep 29 02:17:56.869017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 272/551] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:56 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1708 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:56.968966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:56.977656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:56.979117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:56.980270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d68ebf2c-452b-49d6-bfc9-9c2c6c130133 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1738 microversion: 2.20 time: 0.159214 Sep 29 02:17:56.980836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 280/552] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:56 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:17:57.661855 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:57.663107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:57.669712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:57.670237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:57.670652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:57.671529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:57.672201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:57.672624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:57.850212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-02c32586-9e07-43db-bbb3-0a3240028295 req-ec8a9667-d490-42c0-bd5e-f6a63bbde45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3cc888-a13a-432f-b4c8-a6e268c10910", "name": "network-vif-plugged", "status": "completed", "tag": "24c56e8e-5743-4f19-bd53-651a3880405f"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:17:57.861455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-02c32586-9e07-43db-bbb3-0a3240028295 req-ec8a9667-d490-42c0-bd5e-f6a63bbde45b service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:57.862055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-02c32586-9e07-43db-bbb3-0a3240028295 req-ec8a9667-d490-42c0-bd5e-f6a63bbde45b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:57.862555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-02c32586-9e07-43db-bbb3-0a3240028295 req-ec8a9667-d490-42c0-bd5e-f6a63bbde45b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:57.863182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:57.874147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-868623fb-604a-4d65-aad5-7f5c0cefc9f4 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.216483 Sep 29 02:17:57.874519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-02c32586-9e07-43db-bbb3-0a3240028295 req-ec8a9667-d490-42c0-bd5e-f6a63bbde45b service nova] Creating event network-vif-plugged:24c56e8e-5743-4f19-bd53-651a3880405f for instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 on hv-cinder-73306 Sep 29 02:17:57.878980 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 273/553] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:57 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:57.879879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-02c32586-9e07-43db-bbb3-0a3240028295 req-ec8a9667-d490-42c0-bd5e-f6a63bbde45b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034466 Sep 29 02:17:57.880716 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 281/554] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:17:57.891202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:57.891926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:57.898694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:57.899180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:57.899616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:57.900361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:57.900813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:57.901241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:58.006552 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:58.007256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:58.013572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:58.014073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:58.014506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:58.015198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:58.015649 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:58.016065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:58.043253 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:58.052127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ffb280e-3410-425f-a20a-bfc272ebc74b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1708 microversion: 2.1 time: 0.164828 Sep 29 02:17:58.052552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 274/555] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:57 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:17:58.148861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:58.157029 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:58.158602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:58.159757 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f73a20ac-8640-464d-9a23-373709841936 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1720 microversion: 2.20 time: 0.157631 Sep 29 02:17:58.160854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 282/556] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:58 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:17:58.899847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:58.900548 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:58.910948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:58.911372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:58.911805 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:58.912483 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:58.912932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:58.913349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:59.052872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:59.060917 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-909de713-de53-475d-9002-1c997afa8aac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.167255 Sep 29 02:17:59.061492 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 275/557] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:58 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:59.075264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:59.075849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:59.082600 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:59.083157 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:59.083592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:59.084279 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:59.084733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:59.085135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:59.184744 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:17:59.185343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:17:59.191720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:59.192205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:59.192634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:59.193327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:17:59.193770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:17:59.194222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:17:59.223927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:59.232714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c707c627-b147-420c-b618-e5815fd0431a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1708 microversion: 2.1 time: 0.161289 Sep 29 02:17:59.233319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 283/558] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:17:59 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:17:59.326469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:59.336210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:59.337615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:17:59.338812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9429f3ba-bc3b-4bf7-93e7-1c1d1b5b0faf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1720 microversion: 2.20 time: 0.157996 Sep 29 02:17:59.339367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 276/559] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:17:59 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:00.084260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:00.084876 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:00.091821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:00.092300 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:00.092726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:00.093406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:00.093852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:00.094274 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:00.233803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:00.242738 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c8936bb4-2bb8-4640-a6c0-a4cebabe2ccf tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.162551 Sep 29 02:18:00.243316 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 284/560] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:00 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:00.256022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:00.256616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:00.265528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:00.266252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:00.266822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:00.267809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:00.268477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:00.269064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:00.364245 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:00.364969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:00.371404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:00.372004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:00.372494 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:00.373253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:00.373705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:00.374164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:00.405495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:00.414480 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e83a7508-93f4-47a3-9acd-1d5ab07f2ed5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1712 microversion: 2.1 time: 0.162268 Sep 29 02:18:00.415276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 277/561] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:00 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1712 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:00.509784 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:00.518047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:00.519477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:00.520811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5c0f3cce-1d39-4cf7-84d3-ef366297d0dd tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1720 microversion: 2.20 time: 0.161001 Sep 29 02:18:00.521367 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 285/562] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:00 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:01.267790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:01.268554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:01.278833 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:01.279480 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:01.280080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:01.280997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:01.281646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:01.282271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:01.416089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:01.424629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f2e330ac-22d7-4fd0-b0ef-c669bdbc9d39 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.161846 Sep 29 02:18:01.425168 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 278/563] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:01 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:01.550460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:01.551423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:01.560016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:01.560509 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:01.560949 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:01.561650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:01.562131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:01.562558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:01.701196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:01.709907 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:01.711358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:01.712505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-306423cd-7932-4b38-9af2-ea3e658b48ab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1720 microversion: 2.20 time: 0.168937 Sep 29 02:18:01.713102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 286/564] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:01 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:01.787589 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-c6f7c6e9-8e2b-496e-8afc-2de099adb0e0 req-b3aea2a2-1e0b-4f24-90f7-bb294e1d4803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:01.797757 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c6f7c6e9-8e2b-496e-8afc-2de099adb0e0 req-b3aea2a2-1e0b-4f24-90f7-bb294e1d4803 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:01.798357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c6f7c6e9-8e2b-496e-8afc-2de099adb0e0 req-b3aea2a2-1e0b-4f24-90f7-bb294e1d4803 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:01.798790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-c6f7c6e9-8e2b-496e-8afc-2de099adb0e0 req-b3aea2a2-1e0b-4f24-90f7-bb294e1d4803 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:01.810200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-c6f7c6e9-8e2b-496e-8afc-2de099adb0e0 req-b3aea2a2-1e0b-4f24-90f7-bb294e1d4803 service nova] Creating event network-vif-unplugged:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:18:01.815227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-c6f7c6e9-8e2b-496e-8afc-2de099adb0e0 req-b3aea2a2-1e0b-4f24-90f7-bb294e1d4803 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031458 Sep 29 02:18:01.815825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 279/565] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:18:02.455937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:02.456707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:02.469490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:02.470792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:02.472012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:02.473838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:02.475068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:02.475766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:02.615597 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:02.624101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2dd669f0-3611-4e74-8068-fe2521066493 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1319 microversion: 2.1 time: 0.173012 Sep 29 02:18:02.624775 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 287/566] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:02 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:02.738776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:02.739342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:02.746202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:02.746899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:02.747486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:02.748355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:02.748961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:02.749945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:02.902201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:02.911159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:02.912921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:02.913954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b4788b4-d035-4877-8ad6-fd0f52584d79 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1723 microversion: 2.20 time: 0.180487 Sep 29 02:18:02.914514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 280/567] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:02 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:02.939471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99d5c5b4-d478-42be-8be6-d7d34cd2257b"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:02.943083 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:02.949306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:02.949808 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:02.950267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:02.950943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:02.951385 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:02.951800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:02.955728 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=100 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:03.271458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6654f38b-4a41-4bce-b987-964de7684c86 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336061 Sep 29 02:18:03.272366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 288/568] 10.222.0.61 () {62 vars in 1364 bytes} [Thu Sep 29 02:18:02 2022] POST /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments => generated 188 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:18:03.416270 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:03.416887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:03.422997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.423484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.423911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.424594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.425042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.425424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.514418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 29 02:18:03.595061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6fdf932-3e28-470a-955f-330da3ca414f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/action" status: 202 len: 0 microversion: 2.20 time: 0.182542 Sep 29 02:18:03.595668 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 281/569] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 29 02:18:03 2022] POST /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:18:03.604089 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:03.605148 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:03.612968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.613651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.614348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.615434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.616046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.617167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.660913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:03.662385 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:03.674430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.674930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.675484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.676396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.676910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.677383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.682918 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:03.764992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:03.773811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:03.775482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:03.776679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c7a7c476-81e0-4667-9927-8c6b92a7331f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1809 microversion: 2.20 time: 0.176656 Sep 29 02:18:03.777550 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 289/570] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:03 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:18:03.868300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:03.876266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4da3800-123c-47cd-86a8-719590a838eb tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1508 microversion: 2.1 time: 0.224091 Sep 29 02:18:03.876822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 282/571] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:03 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:03.900587 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e780256-d327-4913-aa41-d1f22959cb27", "device": "/dev/sdb"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:03.903101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:03.909538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.910128 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.910566 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:03.911281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:03.912160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:03.912842 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:04.495485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-65f67041-abd7-4654-9629-b27c99609684 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "POST /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.599257 Sep 29 02:18:04.496218 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 290/572] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:18:03 2022] POST /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:18:04.804966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:04.805572 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:04.809066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:04.812992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:04.813475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:04.813910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:04.814631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:04.815083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:04.815504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:04.951552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:04.960617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:04.962104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:04.963301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e1b39d5-09bc-4b3e-8285-4dfc420ce0ad tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.162398 Sep 29 02:18:04.963821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 283/573] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:04 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:05.995910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:05.996908 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:06.007506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:06.007906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:06.008344 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:06.009037 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:06.009468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:06.009906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:06.147503 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:06.160910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:06.163206 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:06.164371 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2455ffcc-b2d2-4562-852b-87a33d3b9871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.177291 Sep 29 02:18:06.164956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 291/574] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:05 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:07.188959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:07.189560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:07.196383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:07.197017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:07.197658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:07.198358 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:07.198808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:07.199225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:07.338344 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:07.347411 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:07.348860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:07.350036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-83fd7ef5-60ba-42af-8288-1cb9db4c374d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.165053 Sep 29 02:18:07.350739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 284/575] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:07 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:08.379890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:08.380827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:08.383913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=94 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:08.389534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:08.390040 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:08.390498 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:08.391192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:08.391646 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:08.392067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:08.521697 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:08.530638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:08.532081 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:08.533252 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-db7e92b5-c88b-4e13-bbc3-9ba7feb28d05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.160069 Sep 29 02:18:08.533793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 292/576] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:08 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:09.559783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:09.560387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:09.567371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:09.567873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:09.568302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:09.568995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:09.569470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:09.569867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:09.707761 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:09.721404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:09.723775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:09.725599 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df2893c3-0dad-49a3-8cbc-52d5020da2b8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.169516 Sep 29 02:18:09.726337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 285/577] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:09 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:10.756365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:10.757330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:10.764641 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:10.765120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:10.765551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:10.766399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:10.766857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:10.767300 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:10.906128 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:10.916352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:10.917760 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:10.918945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a8eb5302-1c7d-4d6a-8119-a216321c658f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.169302 Sep 29 02:18:10.919497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 293/578] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:10 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:11.947851 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:11.948434 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:11.956014 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:11.956502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:11.956928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:11.957633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:11.958156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:11.958604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:12.096512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:12.106313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:12.107745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:12.108898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-feaaa5a4-f786-4002-a240-13bb8519805b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.166799 Sep 29 02:18:12.109461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 286/579] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:11 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:13.134368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:13.135557 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:13.142327 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:13.142801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:13.143227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:13.144117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:13.144566 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:13.144979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:13.300533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:13.309901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:13.311472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:13.312626 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-24ef4ad5-b10e-475b-80df-5edceb6be38f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1751 microversion: 2.20 time: 0.182042 Sep 29 02:18:13.313188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 294/580] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:13 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:14.339033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:14.339573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:14.346789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:14.347272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:14.347706 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:14.348397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:14.348852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:14.349276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:14.493648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:14.503088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:14.504495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:14.505637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d3183c49-ebd5-4ada-b12b-ea408483f270 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.170650 Sep 29 02:18:14.506247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 287/581] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:14 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:15.535651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:15.536574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:15.547977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:15.548835 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:15.549573 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:15.550831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:15.551587 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:15.552429 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:15.693151 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:15.702771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:15.704205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:15.705372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2771ae73-0220-4367-8e4d-3f303f52ab8d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.176663 Sep 29 02:18:15.706131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 295/582] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:15 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:16.735296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:16.736481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:16.746850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:16.747339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:16.747809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:16.748507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:16.748963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:16.749392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:16.887813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:16.896814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:16.898291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:16.899425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2f4993b-983f-4fa8-84e6-b2b4d401c67e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.171145 Sep 29 02:18:16.899995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 288/583] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:16 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:17.928937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:17.930075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:17.940992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:17.941781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:17.942551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:17.943677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:17.944423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:17.945121 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:18.080994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:18.094778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:18.097043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:18.098795 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b0699e53-e801-4789-a698-a827ad597998 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.176257 Sep 29 02:18:18.099594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 296/584] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:17 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:19.126722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:19.127356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:19.135723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:19.136343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:19.137114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:19.137911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:19.138486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:19.139105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:19.367919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:19.377270 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:19.378737 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:19.379884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0608abc-54b6-47ae-860f-9b2f41ed01f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.257146 Sep 29 02:18:19.380457 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 289/585] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:19 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:20.405640 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:20.406265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:20.412798 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:20.413271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:20.413701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:20.414404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:20.414855 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:20.415265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:20.592335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:20.601692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:20.603150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:20.604313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2c4627b1-9847-46d6-9ac3-569cb16ce075 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.203039 Sep 29 02:18:20.604871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 297/586] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:20 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:21.632751 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:21.633325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:21.640994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:21.641490 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:21.641903 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:21.642931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:21.643382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:21.643840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:21.805967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:21.821922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:21.823417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:21.824976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9682961-bc1a-455d-866b-b8563e844871 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.195970 Sep 29 02:18:21.825579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 290/587] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:21 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:22.857980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:22.858799 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:22.866033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:22.866579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:22.866983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:22.867675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:22.868125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:22.868539 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:23.000952 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:23.010114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:23.011543 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:23.012749 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-356b3763-203c-4aea-aa65-8dc48e37e4c6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.159016 Sep 29 02:18:23.013328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 298/588] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:22 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:24.042055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:24.043523 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:24.051657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:24.052342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:24.052856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:24.053602 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:24.055017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:24.055448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:24.200843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:24.209915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:24.211372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:24.212535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cbed0a23-03da-4aaf-ad51-592b6d2554a7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.175516 Sep 29 02:18:24.213110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 291/589] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:24 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:25.242440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:25.243735 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:25.250925 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:25.251527 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:25.252067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:25.252926 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:25.253436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:25.253946 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:25.402558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:25.411481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:25.412917 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:25.414118 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5ce7ca57-f27e-48d9-854d-90258e57c9bf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.175687 Sep 29 02:18:25.414683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 299/590] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:25 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:26.445657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:26.446644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:26.455530 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:26.456007 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:26.456435 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:26.457176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:26.457596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:26.458026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:26.590133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:26.599338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:26.600757 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:26.601903 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d903b807-5fea-4138-bca0-80ba0ef9348d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.162902 Sep 29 02:18:26.602493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 292/591] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:26 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:27.632153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:27.633093 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:27.644038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:27.644681 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:27.645307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:27.646326 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:27.646966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:27.647577 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:27.782701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:27.786225 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:27.791580 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:27.792993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:27.794176 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9035ceed-cc2a-4c39-afbf-590c42910633 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.168727 Sep 29 02:18:27.794841 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 300/592] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:27 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:28.821569 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:28.822264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:28.831471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:28.831973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:28.832403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:28.833089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:28.833531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:28.833956 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:28.967841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:28.978211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:28.979637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:28.980819 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7368e6a-cd2b-4003-8b72-65a35ca93aba tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.163989 Sep 29 02:18:28.981380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 293/593] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:28 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:30.012930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:30.014936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:30.024593 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:30.025083 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:30.025525 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:30.026270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:30.026724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:30.027150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:30.169078 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:30.179148 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:30.180496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:30.181671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6e3fcb0a-8475-4688-916a-d66b863d1037 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.177118 Sep 29 02:18:30.182269 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 301/594] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:30 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:31.207640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:31.208324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:31.215071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:31.215554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:31.215957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:31.216895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:31.217346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:31.217759 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:31.367960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:31.376731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:31.378182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:31.379345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae0602c7-2f82-4ac1-8fa8-78fc653e245a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.175876 Sep 29 02:18:31.379905 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 294/595] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:31 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:32.390782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:32.391490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:32.399329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:32.399813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:32.400236 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:32.400909 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:32.401356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:32.401772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:32.404792 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:32.405397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:32.411936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:32.412414 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:32.412862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:32.414219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:32.414660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:32.415081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:32.528343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lazy-loading 'services' on Instance uuid 1c3cc888-a13a-432f-b4c8-a6e268c10910 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:18:32.549486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:32.558951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:32.560383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:32.561690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-370eadf6-56cf-4d6d-b4a3-a31d9226aaa8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.160722 Sep 29 02:18:32.562268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 295/596] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:32 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:32.652693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8937fa01-a247-431d-8db9-fcc113cc1273 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910/os-volume_attachments/7e780256-d327-4913-aa41-d1f22959cb27" status: 202 len: 0 microversion: 2.1 time: 0.266343 Sep 29 02:18:32.653888 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 302/597] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:18:32 2022] DELETE /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910/os-volume_attachments/7e780256-d327-4913-aa41-d1f22959cb27 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:18:33.587690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:33.588268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:33.595162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:33.595666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:33.596088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:33.596779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:33.597228 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:33.597652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:33.733995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:33.736275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=87 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:33.745721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:33.747253 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:33.748436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-452dd5e2-48e8-43ad-a4c5-65de35b453af tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.164670 Sep 29 02:18:33.749197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 296/598] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:33 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:34.776104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:34.776803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:34.783838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:34.784414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:34.784980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:34.785730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:34.786224 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:34.786635 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:34.923072 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:34.932548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:34.933980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:34.935163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5964fd8f-cebb-44ad-9b96-3da214ce0872 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.164341 Sep 29 02:18:34.935721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 303/599] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:34 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:35.961316 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:35.962242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:35.964034 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=27 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:35.978287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:35.978770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:35.979273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:35.979977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:35.980433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:35.980859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:36.116721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:36.126881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:36.128207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:36.129406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ef2f021-a56d-42c8-ba4a-b401a1c8bd05 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.172442 Sep 29 02:18:36.130246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 297/600] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:35 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:36.452638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:36.456255 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:36.466376 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:36.466882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:36.467292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:36.468001 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:36.468484 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:36.468902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:36.561472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-08843829-0106-478b-b68e-39c6a30ecd77 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/action" status: 202 len: 0 microversion: 2.1 time: 0.115814 Sep 29 02:18:36.566473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 304/601] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:18:36 2022] POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:18:36.572064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:36.572696 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:36.581002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:36.581898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:36.582558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:36.583421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:36.584018 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:36.584586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:36.746937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:36.755630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-88d1b64d-98cb-4177-bac5-a956e1e331ea tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.187895 Sep 29 02:18:36.756200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 298/602] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:36 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:37.156817 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:37.157912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:37.164197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:37.164759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:37.165190 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:37.165961 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:37.166529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:37.167089 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:37.319298 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:37.328149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:37.329589 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:37.330791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8c8e0bab-612d-4e50-b2e6-4c581a1ed58a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.178501 Sep 29 02:18:37.331348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 305/603] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:37 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:37.782385 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:37.783114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:37.790991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:37.791552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:37.792055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:37.792847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:37.793517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:37.794021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:37.943776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:37.953249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-91847b6a-fdca-4d03-a2fb-8c8f51d5d388 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.175801 Sep 29 02:18:37.954152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 299/604] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:37 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:38.359379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:38.360227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:38.367800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:38.368289 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:38.368722 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:38.369425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:38.369882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:38.370328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:38.509635 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:38.525224 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:38.526726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:38.528149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c620eff4-8ac9-412f-9996-69d8d2b4d208 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.174690 Sep 29 02:18:38.528926 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 306/605] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:38 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:38.977093 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:38.977675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:38.984711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:38.985210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:38.985644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:38.986378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:38.986832 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:38.987261 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:39.139675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:39.152251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2ed3aa3-c13d-481a-a470-c797152eb3ed tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.179054 Sep 29 02:18:39.152901 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 300/606] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:38 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:39.558636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:39.559216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:39.561720 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=30 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:39.567224 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:39.567699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:39.568131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:39.568811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:39.569254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:39.569677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:39.697877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:39.706809 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:39.708260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:39.709410 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b19bb910-9550-4023-9d3e-ca17e99ef07b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.157237 Sep 29 02:18:39.709967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 307/607] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:39 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:40.181375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:40.182030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:40.189130 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:40.189701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:40.190186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:40.190912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:40.191353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:40.191774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:40.339593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:40.348082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0f83223f-2e0e-4f7e-b9ab-61e5a04c6dc7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.171925 Sep 29 02:18:40.348650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 301/608] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:40 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:40.737408 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:40.738448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:40.746243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:40.746810 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:40.747273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:40.747971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:40.748406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:40.748828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:40.890984 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:40.899610 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:40.901002 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:40.902205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e25aa619-3715-4dfe-895d-bafeee31e7e3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.169414 Sep 29 02:18:40.903103 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 308/609] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:40 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:41.377080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:41.378026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:41.388496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:41.388972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:41.389398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:41.390114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:41.390564 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:41.390981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:41.549920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:41.562304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a5ba04a-36a2-4518-945f-6a5ba2385ec6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.191899 Sep 29 02:18:41.562851 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 302/610] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:41 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:41.939144 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:41.940152 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:41.950979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:41.951455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:41.951890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:41.952580 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:41.953033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:41.953455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:42.093979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:42.107123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:42.108669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:42.109830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-343d26f4-4e2a-4038-a449-485db1bdb53b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.177632 Sep 29 02:18:42.110420 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 309/611] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:41 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:42.585889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:42.586499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:42.593889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:42.594443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:42.594921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:42.595676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:42.596184 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:42.596634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:42.746198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:42.754705 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-398830e6-d3d6-4a87-8f51-e70dc2d453c3 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.173315 Sep 29 02:18:42.755275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 303/612] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:42 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:43.136407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:43.137039 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:43.144101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:43.144583 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:43.145017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:43.145707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:43.146187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:43.146607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:43.282722 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:43.295294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:43.296729 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:43.297928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b57d464d-838a-452b-a7eb-01c2598034f3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.165635 Sep 29 02:18:43.298538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 310/613] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:43 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:43.779128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:43.779928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:43.786902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:43.787383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:43.787807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:43.788495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:43.788935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:43.789345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:43.942640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:43.951387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6449b468-47be-492b-968a-f263775086f1 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.176100 Sep 29 02:18:43.951962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 304/614] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:43 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:44.327256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:44.327869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:44.334756 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:44.335234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:44.335675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:44.336362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:44.336815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:44.337238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:44.481216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:44.490469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:44.491898 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:44.493049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-223c46b3-6705-4e08-88d0-a07a2c0e6768 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.171787 Sep 29 02:18:44.493603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 311/615] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:44 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:44.975271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:44.975892 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:44.982476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:44.982948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:44.983372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:44.984261 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:44.984709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:44.985122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:45.140856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:45.154754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63662cb6-750f-42a7-a141-065421c35252 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.183130 Sep 29 02:18:45.155627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 305/616] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:44 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:18:45.518233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:45.518849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:45.525595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:45.525931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:45.526409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:45.527058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:45.527525 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:45.527915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:45.656521 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:45.665755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:45.667216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:45.668365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1ecfa9a7-78aa-48fc-82dc-c7e32db49fdb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.154318 Sep 29 02:18:45.668926 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 312/617] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:45 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:46.178441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:46.178976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:46.186145 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:46.186747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:46.187434 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:46.188010 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:46.188461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:46.188880 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:46.422647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:46.431373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2f0c013d-9d4b-4579-bd14-41eb80c32ef2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1753 microversion: 2.1 time: 0.256855 Sep 29 02:18:46.432055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 306/618] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:46 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1753 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:46.698296 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:46.699110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:46.710104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:46.710937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:46.711653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:46.712788 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:46.713535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:46.714269 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:46.851811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:46.864311 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:46.865757 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:46.866966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7651cc6f-d71e-4d3c-936e-042636cc3a1d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.175551 Sep 29 02:18:46.867526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 313/619] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:46 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:47.458917 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:47.459795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:47.470025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.470511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.470964 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.471642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.472086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.472507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.628920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:47.637244 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-027719dc-d0b6-4f7b-8e60-ee30693a4777 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.185055 Sep 29 02:18:47.637813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 307/620] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:47 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:47.665776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:47.666367 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:47.672942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.673428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.673865 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.674577 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.675030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.675455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.704186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:18:47.740167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:47.790778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2368b6b6-7563-4d56-a4a8-fc7a8e6539ac tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 204 len: 0 microversion: 2.1 time: 0.128589 Sep 29 02:18:47.791346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 314/621] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:18:47 2022] DELETE /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:18:47.801319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:47.802108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:47.809240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.809805 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.810632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.811514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.812058 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.812674 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.892264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:47.892956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:47.899028 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.899504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.899935 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.900621 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:47.901066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:47.901479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:47.949099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:47.957190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42473ff9-f7b3-4e73-bd3d-ac05cc0d56e6 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1514 microversion: 2.1 time: 0.160877 Sep 29 02:18:47.957761 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 308/622] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:47 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:48.035409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:48.044669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:48.046170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:48.047607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-eb73d427-e831-4274-b4bb-1d28b2693b39 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.159624 Sep 29 02:18:48.048153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 315/623] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:47 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:18:48.668387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:48.669347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:48.677853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:48.678371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:48.678802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:48.679499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:48.679950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:48.680370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:48.840777 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:48.851201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a3352226-2960-48d3-8e7e-1e8dd39ae0b7 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.191880 Sep 29 02:18:48.851782 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 309/624] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:48 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:48.984603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:48.985602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:48.997233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:48.998068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:48.998856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:49.000035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:49.000779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:49.001476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:49.073917 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:49.074571 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:49.080842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:49.081741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:49.081741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:49.082439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:49.082910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:49.083328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:49.139276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:49.147319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c5f11feb-be5d-49b7-be0f-d58afd4321c7 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1514 microversion: 2.1 time: 0.169158 Sep 29 02:18:49.148127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 316/625] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:48 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:49.217573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:49.226956 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:49.228379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:49.229529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-523c3c97-26d2-4887-808d-d6bb18a6f276 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.160228 Sep 29 02:18:49.230141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 310/626] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:49 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:49.878700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:49.879533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:49.885828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:49.886345 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:49.886784 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:49.887578 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:49.888344 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:49.889025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:50.035611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:50.046515 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a65a216f-bc2f-41d1-8d5a-65295ae9a4f9 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.173492 Sep 29 02:18:50.047127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 317/627] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:49 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:50.171348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:50.171980 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:50.179373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:50.179828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:50.180288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:50.180970 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:50.181433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:50.181856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:50.256361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:50.256975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:50.263285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:50.263772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:50.264204 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:50.264910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:50.265365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:50.265793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:50.412660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:50.421574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:50.423011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:50.424164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-164bb134-7ff9-4777-9956-31a88dbabf3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.173014 Sep 29 02:18:50.424742 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 318/628] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:50 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:50.434882 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:50.444406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2596d7f-20ae-46be-915b-712a9b0a9141 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1514 microversion: 2.1 time: 0.277067 Sep 29 02:18:50.444981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 311/629] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:50 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:50.795031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-6e5c4fa0-1ac7-4140-8aac-f163f0e0350f req-7199a96a-d58d-4d46-afd8-135d15b31d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3cc888-a13a-432f-b4c8-a6e268c10910", "name": "network-vif-deleted", "tag": "24c56e8e-5743-4f19-bd53-651a3880405f"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:50.804882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-6e5c4fa0-1ac7-4140-8aac-f163f0e0350f req-7199a96a-d58d-4d46-afd8-135d15b31d39 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:50.805282 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-6e5c4fa0-1ac7-4140-8aac-f163f0e0350f req-7199a96a-d58d-4d46-afd8-135d15b31d39 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:50.805714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-6e5c4fa0-1ac7-4140-8aac-f163f0e0350f req-7199a96a-d58d-4d46-afd8-135d15b31d39 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:50.816816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-6e5c4fa0-1ac7-4140-8aac-f163f0e0350f req-7199a96a-d58d-4d46-afd8-135d15b31d39 service nova] Creating event network-vif-deleted:24c56e8e-5743-4f19-bd53-651a3880405f for instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 on hv-cinder-73306 Sep 29 02:18:50.822048 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-6e5c4fa0-1ac7-4140-8aac-f163f0e0350f req-7199a96a-d58d-4d46-afd8-135d15b31d39 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094981 Sep 29 02:18:50.822633 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 319/630] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:18:51.074525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:51.075521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:51.085508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:51.086366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:51.087076 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:51.088228 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:51.088939 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:51.089628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:51.235989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:51.249160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-10e0af82-6541-4f65-bf6d-17c6c99b1a19 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.181055 Sep 29 02:18:51.249970 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 312/631] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:51 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:51.456797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:51.457579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:51.464232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:51.464748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:51.465176 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:51.465859 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:51.466342 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:51.466759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:51.467924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:51.468532 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:51.474915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:51.475404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:51.475839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:51.476526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:51.476975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:51.477401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:51.493422 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:18:51.541399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:51.549847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bbe1ce38-dd23-4537-b800-4de6d7417ff2 tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1472 microversion: 2.1 time: 0.085701 Sep 29 02:18:51.550807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 313/632] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:51 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1472 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:51.605786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:51.615433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:51.616858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:51.618033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ff6269b1-bd6b-4928-ad35-f42724580de8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.169568 Sep 29 02:18:51.618607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 320/633] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:51 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:52.278566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:52.279512 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:52.290472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.291272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.291985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.293117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.293867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.294697 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.444086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:52.452376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-66730a5f-f21e-45a4-9803-54a074c4062a tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.180355 Sep 29 02:18:52.452938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 314/634] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:52 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:52.575007 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:52.575869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:52.587343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.588629 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.589351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.590549 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.591297 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.591975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.631215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.631730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.632195 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.632685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lazy-loading 'fault' on Instance uuid 1c3cc888-a13a-432f-b4c8-a6e268c10910 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:18:52.642923 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:52.643504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:52.649993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.650560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.650984 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.651766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:52.652376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:52.652843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:52.675994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb896a1dae34a9dad20c23433855115', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03571a9d7e1e43f1b5eef66eeae55844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:52.684624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-96ca5a0b-5077-4d7a-a223-b7f7bcd64e0a tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 200 len: 1309 microversion: 2.1 time: 0.114826 Sep 29 02:18:52.685324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 321/635] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:52 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:52.801374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:52.810384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:52.811789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:52.812950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c4f7a8e4-bb9d-46a9-b86a-6ee658841556 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.174098 Sep 29 02:18:52.813506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 315/636] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:52 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:53.476380 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:53.476934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:53.484512 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:53.485177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:53.485491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:53.486340 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:53.486906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:53.487399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:53.628521 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:53.636924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-13cef6f2-bbdd-4400-8517-e77e3cf4b17d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.165441 Sep 29 02:18:53.637495 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 322/637] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:53 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:53.710256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:53.710837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] [instance: 1c3cc888-a13a-432f-b4c8-a6e268c10910] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:53.717693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:53.718186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:53.718623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:53.719316 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:53.719768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:53.720192 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:53.733753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] HTTP exception thrown: Instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 could not be found. Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Request method failure captured: Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 HTTP/1.1 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP_JgcVLQnpu4G0bZ0ZQYNDM4hPgVRIJGOG9dcN7OkfvbyEHT1FxuU3rFMxLaICyfb0TYp6nvimIadDNUgtwA4v0kUrwIiFaNHBSYzdjq_A-BQK7NspZxz7_SAgmemA8LZZLgYNrePM6ve_qwHmGOlYqaFtYIabxk8k2N3w9Ur7N4n0 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 03571a9d7e1e43f1b5eef66eeae55844 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotTestJSON-100228761 Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:18:53.735381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_03571a9d7e1e43f1b5eef66eeae55844"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotTestJSON-100228761 Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 03571a9d7e1e43f1b5eef66eeae55844 Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-100228761 Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotTestJSON-100228761-project Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: ffb896a1dae34a9dad20c23433855115 Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotTestJSON-100228761-project Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 could not be found. Sep 29 02:18:53.736791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '1c3cc888-a13a-432f-b4c8-a6e268c10910'} Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 could not be found. Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:18:53.737565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 could not be found. Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 could not be found. Sep 29 02:18:53.739758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:18:53.741159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] Returning 404 to user: Instance 1c3cc888-a13a-432f-b4c8-a6e268c10910 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:18:53.741159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f365c8e7-a5cf-461f-bcef-e4a51ec954af tempest-VolumesSnapshotTestJSON-100228761 tempest-VolumesSnapshotTestJSON-100228761-project] 10.222.0.61 "GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910" status: 404 len: 111 microversion: 2.1 time: 0.031844 Sep 29 02:18:53.741159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 316/638] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:53 2022] GET /compute/v2.1/servers/1c3cc888-a13a-432f-b4c8-a6e268c10910 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:18:53.840133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:53.840718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:53.847815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:53.848004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:53.848314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:53.849002 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:53.849447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:53.849863 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:54.020329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:54.030724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:54.046424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:54.046424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a2fd1562-8735-4bad-afa5-e6e7d225ff2e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.204876 Sep 29 02:18:54.046424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 323/639] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:53 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:54.664679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:54.665678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:54.675217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:54.675912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:54.676345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:54.677040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:54.677485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:54.677905 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:54.826118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:54.834463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f12f633a-9651-4c45-8407-a348200d0a78 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.176435 Sep 29 02:18:54.835030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 317/640] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:54 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:55.065677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:55.066398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:55.073207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:55.073748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:55.074141 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:55.074798 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:55.075275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:55.075687 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:55.215886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:55.224866 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:55.226303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:55.227460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4d4dba9f-2d2a-40db-acb0-798ebf7b4273 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.165685 Sep 29 02:18:55.228017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 324/641] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:55 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:55.861377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:55.862457 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:55.873926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:55.874779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:55.875494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:55.876636 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:55.877389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:55.878230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:56.027317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:56.036488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4687bd1c-e43d-4552-a7dd-1036ed311de6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.181562 Sep 29 02:18:56.037060 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 318/642] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:55 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:56.257687 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:56.258657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:56.269700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:56.270219 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:56.270653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:56.271336 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:56.271785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:56.272200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:56.408798 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:56.419347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:56.420781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:56.421949 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b9040fba-6d50-422a-8220-f8eb4b196319 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.171222 Sep 29 02:18:56.422559 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 325/643] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:56 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:57.064012 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:57.065075 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:57.072776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:57.073256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:57.073680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:57.074396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:57.074852 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:57.075267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:57.226252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:57.240302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bfc005da-f40e-42d9-96c4-7710b7147d74 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.182745 Sep 29 02:18:57.241095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 319/644] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:57 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:57.458182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:57.458828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:57.466666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:57.467209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:57.467698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:57.468469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:57.468982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:57.469456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:57.608010 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:57.617666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:57.619139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:57.620308 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0cae6103-87e3-428a-8719-ce08a37b270d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.168690 Sep 29 02:18:57.620873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 326/645] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:57 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:58.272404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:58.273026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:58.280147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:58.280632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:58.281096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:58.281790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:58.282277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:58.282699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:58.432831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:58.445910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1c3180f9-91ef-4f05-b288-8de76e7b84cb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.179276 Sep 29 02:18:58.446794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 320/646] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:58 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:58.650056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:58.651237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:58.661454 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:58.661943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:58.662412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:58.663110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:58.663564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:58.663988 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:58.809869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:58.821868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:58.823350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:58.824524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2b078d37-fdc5-4ab7-b28d-d5e1acdc8243 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.181304 Sep 29 02:18:58.825084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 327/647] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:58 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:18:59.470590 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:59.471189 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:59.478620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:59.479097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:59.479528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:59.480215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:59.480657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:59.481076 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:59.631615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:18:59.640386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c7c304cb-6b6b-4dbf-a263-979a6f03a6a6 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.173645 Sep 29 02:18:59.640933 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 321/648] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:18:59 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:18:59.803782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-12bbfad2-fa30-407e-805e-678919414946 req-55f46336-22f9-40b7-9686-fb73eff4d748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "name": "network-vif-plugged", "status": "completed", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:18:59.813304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-12bbfad2-fa30-407e-805e-678919414946 req-55f46336-22f9-40b7-9686-fb73eff4d748 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:59.813776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-12bbfad2-fa30-407e-805e-678919414946 req-55f46336-22f9-40b7-9686-fb73eff4d748 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:59.814309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-12bbfad2-fa30-407e-805e-678919414946 req-55f46336-22f9-40b7-9686-fb73eff4d748 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:59.825698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-12bbfad2-fa30-407e-805e-678919414946 req-55f46336-22f9-40b7-9686-fb73eff4d748 service nova] Creating event network-vif-plugged:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:18:59.830610 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-12bbfad2-fa30-407e-805e-678919414946 req-55f46336-22f9-40b7-9686-fb73eff4d748 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084621 Sep 29 02:18:59.831186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 328/649] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:18:59.849439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:18:59.850058 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:18:59.856124 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:59.856604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:59.857030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:59.857705 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:18:59.858190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:18:59.858605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:18:59.995783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:00.005145 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:00.006960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:00.008115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3e164d91-60ff-4509-8506-2aa6e301b13a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.162637 Sep 29 02:19:00.008670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 322/650] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:18:59 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:19:00.664913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:00.665613 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:00.672148 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:00.672627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:00.673054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:00.673747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:00.674226 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:00.674643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:00.833855 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:00.844658 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-66e40876-3a3e-46af-8ea9-c8f2da992497 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.184216 Sep 29 02:19:00.845888 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 329/651] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:00 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:01.046715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:01.047622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:01.058548 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:01.059337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:01.060062 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:01.061184 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:01.061922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:01.062686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:01.212674 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:01.224868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:01.227167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:01.229011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fb4c6b77-dd30-42eb-ac88-9b72f90cb271 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.188786 Sep 29 02:19:01.229830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 323/652] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:19:01 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:19:01.869414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:01.870027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:01.876692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:01.877171 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:01.877601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:01.878325 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:01.878770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:01.879189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:02.027269 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:02.038106 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-cbe19be1-cf55-440d-8473-195dbdb8bcc2 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.171580 Sep 29 02:19:02.050200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 330/653] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:01 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:02.260866 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:02.261489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:02.268193 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:02.268688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:02.269119 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:02.269808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:02.270664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:02.270664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:02.414128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:02.423818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:02.425238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:02.426410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c3ce70f6-550a-43fa-a397-1341de8d427d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.171098 Sep 29 02:19:02.426958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 324/654] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:19:02 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:19:03.061123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:03.061738 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:03.070037 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:03.070528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:03.070963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:03.071663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:03.072111 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:03.072533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:03.277379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:03.286823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:03.290838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-41d573bb-1ed3-4500-9047-5a1ba54155ac tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.233085 Sep 29 02:19:03.294448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 331/655] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:03 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:03.453839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:03.454474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:03.460953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:03.461479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:03.461908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:03.462652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:03.463092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:03.463831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:03.601838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:03.610989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:03.612418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:03.613580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0dfc18a5-bf7e-4efa-b2ec-b8a6570c310e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1807 microversion: 2.20 time: 0.164551 Sep 29 02:19:03.614503 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 325/656] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:19:03 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:19:04.315491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:04.316066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:04.323982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:04.324455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:04.324886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:04.325568 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:04.326034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:04.326454 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:04.472104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:04.480824 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c48d9a4d-2b75-4309-84b3-2300386d4c68 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1758 microversion: 2.1 time: 0.169307 Sep 29 02:19:04.481443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 332/657] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:04 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:04.639489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:04.640124 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:04.648865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:04.649224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:04.654979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:04.654979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:04.654979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:04.654979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:04.792845 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:04.806569 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:04.808680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:04.809827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f3429d6-ac57-4d4c-9207-e460fef89ed9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1794 microversion: 2.20 time: 0.174474 Sep 29 02:19:04.810409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 326/658] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:19:04 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1794 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:19:05.506706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:05.507401 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:05.516451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:05.517102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:05.517683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:05.518624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:05.519226 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:05.519786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:05.674903 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:05.688202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0d90d77b-9caf-437b-9c76-4467a308e36f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1761 microversion: 2.1 time: 0.186907 Sep 29 02:19:05.688821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 333/659] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:05 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1761 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:06.400845 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b27e02b2-2c23-4452-8e8a-dda08623f7ea"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:06.403389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:06.405239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=60 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:06.410665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:06.411138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:06.411566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:06.412247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:06.412698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:06.413116 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:09.997484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b13e6e72-7715-426d-bfc1-871e0c2d11e9 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.705209 Sep 29 02:19:09.998226 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 327/660] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:19:06 2022] POST /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments => generated 194 bytes in 3707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:19:18.726334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:18.728776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:18.731368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:18.732021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=12 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:18.736996 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:18.737464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:18.737903 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:18.738615 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:18.739065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:18.739486 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:18.765854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lazy-loading 'flavor' on Instance uuid 85c64925-0e77-4fe1-a53f-c7104523e59d {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:19:18.905044 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-67580eca-81c5-47bf-b867-09638c492c16 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/action" status: 200 len: 32 microversion: 2.1 time: 0.182695 Sep 29 02:19:18.905975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 334/661] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:19:18 2022] POST /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/action => generated 32 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:19:18.913901 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:18.918206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:18.918912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:18.925730 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:18.926210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:18.926644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:18.927440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:18.927944 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:18.928198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:19.140645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:19.149587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4f7adf6f-6036-4d44-b464-f9c5fccbe465 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.237146 Sep 29 02:19:19.150165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 328/662] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:18 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:20.177945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:20.178763 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:20.186290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:20.186708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:20.187149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:20.187849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:20.188315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:20.188741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:20.326407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:20.335257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3a5c44df-af45-4a80-800e-eb7f10e65e81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.164524 Sep 29 02:19:20.335879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 335/663] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:20 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:21.375168 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:21.376431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:21.383641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:21.384121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:21.384553 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:21.385447 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:21.385686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:21.386344 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:21.401659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:21.556743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:21.565252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd492a2a-220c-4b75-a4bc-b54ec0c88341 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.209345 Sep 29 02:19:21.565794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 329/664] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:21 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:22.589306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:22.589890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:22.596786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:22.597263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:22.597700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:22.598429 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:22.598885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:22.599299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:22.743293 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:22.758169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-12d4074c-0275-4d7c-979a-c5530bd1610c tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.171413 Sep 29 02:19:22.758754 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 336/665] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:22 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:23.787392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:23.788167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:23.795097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:23.795587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:23.796024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:23.796720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:23.797173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:23.797599 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:23.931278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:23.939769 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab68d982-f817-48fb-b75a-9d40eeb997c8 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.158350 Sep 29 02:19:23.940329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 330/666] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:23 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:24.967654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:24.968563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:24.979712 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:24.980517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:24.981286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:24.982513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:24.983261 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:24.983960 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:25.122837 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:25.131614 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-aeb39695-6669-45e6-b7ce-5c130d10906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.170387 Sep 29 02:19:25.132303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 337/667] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:24 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:26.159223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:26.160363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:26.168621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:26.169108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:26.169545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:26.170279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:26.170739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:26.171149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:26.316597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:26.329069 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1488ae3b-ba18-4174-bf5d-06f7f63d89e1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.176085 Sep 29 02:19:26.329756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 331/668] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:26 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:27.354907 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:27.355542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:27.362739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:27.363225 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:27.363657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:27.364354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:27.364837 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:27.365260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:27.499758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:27.511189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2d6ee4c2-458c-4491-9730-2e6119b70cf5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.160522 Sep 29 02:19:27.511772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 338/669] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:27 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:28.540379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:28.541341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:28.552222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:28.553653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:28.553917 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:28.555107 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:28.555574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:28.555997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:28.701397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:28.710581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe1b1e1d-1ef6-4df8-822c-3cac6a8b3a7b tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.176881 Sep 29 02:19:28.711155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 332/670] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:28 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:29.739630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:29.740526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:29.751358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:29.752165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:29.752897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:29.754064 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:29.754851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:29.755594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:29.892871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:29.901544 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5e416db3-a093-4c44-a447-ab7db2af7ad0 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.169515 Sep 29 02:19:29.902179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 339/671] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:29 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:30.930587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:30.931301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:30.939821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:30.940418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:30.940951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:30.941799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:30.942403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:30.942928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:31.090433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:31.102902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-57aeee75-ea68-44f8-83e8-a2f889de29c6 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.178600 Sep 29 02:19:31.103680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 333/672] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:30 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:32.135314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:32.136139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:32.145125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:32.145769 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:32.146389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:32.147313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:32.148690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:32.149274 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:32.288969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:32.297273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a51e786a-2c81-4ef2-ae77-4e5bae91dc37 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.168056 Sep 29 02:19:32.297825 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 340/673] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:32 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:33.324949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:33.325900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:33.336546 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:33.337030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:33.337467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:33.338188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:33.338645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:33.339068 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:33.482313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:33.495853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e486fd45-b9b1-4570-9081-defcf0a41c13 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1734 microversion: 2.1 time: 0.176788 Sep 29 02:19:33.496663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 334/674] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:33 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:34.520299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:34.520917 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:34.528118 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.528606 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.529043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:34.529746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.530247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.530675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:34.661490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:34.673980 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0b2d5f8e-3b86-46ca-9e2f-61c7a2553ef5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1714 microversion: 2.1 time: 0.157516 Sep 29 02:19:34.674769 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 341/675] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:34 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:34.790170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:34.790662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:34.797275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.797761 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.798521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:34.799226 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.799683 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.800110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:34.882733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] HTTP exception thrown: Cannot 'detach_volume' instance 85c64925-0e77-4fe1-a53f-c7104523e59d while it is in vm_state rescued Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Request method failure captured: Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments/b27e02b2-2c23-4452-8e8a-dda08623f7ea HTTP/1.1 Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8lXd1WxAgFWCWk8vlemYr3D-VyoxlciJ08RNEIH8neIkGUeS_aL2mTDTexl3hDbl4KKNEbUfdJO6OvXxM-rmHcjaiyK-0yPzWW_hts6neyp5myMnzA8KviWHQT9AF51PlHwPyJcuafjKvexmb72leM3wi6Ujz8-3hhxx6vXeOkrXg Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:19:34.884436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 0df60784a8b3468ca19ec2cee1d929e5 Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:19:34.886040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Cannot 'detach_volume' instance 85c64925-0e77-4fe1-a53f-c7104523e59d while it is in vm_state rescued Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'server_id': '85c64925-0e77-4fe1-a53f-c7104523e59d', 'id': 'b27e02b2-2c23-4452-8e8a-dda08623f7ea'} Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:19:34.886861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 85c64925-0e77-4fe1-a53f-c7104523e59d while it is in vm_state rescued Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 85c64925-0e77-4fe1-a53f-c7104523e59d while it is in vm_state rescued Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:34.888110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Returning 409 to user: Cannot 'detach_volume' instance 85c64925-0e77-4fe1-a53f-c7104523e59d while it is in vm_state rescued {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:19:34.889112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7517cf11-bf30-4679-ac63-0625607c6159 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments/b27e02b2-2c23-4452-8e8a-dda08623f7ea" status: 409 len: 152 microversion: 2.1 time: 0.099776 Sep 29 02:19:34.889112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 335/676] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:19:34 2022] DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments/b27e02b2-2c23-4452-8e8a-dda08623f7ea => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 29 02:19:34.895019 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:34.895551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:34.901933 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.902451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.902879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:34.903598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.904045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.904523 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:34.982239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d1e5f043-dace-4979-9555-67884ac25a62 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "POST /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/action" status: 202 len: 0 microversion: 2.1 time: 0.090943 Sep 29 02:19:34.982871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 342/677] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:19:34 2022] POST /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:19:34.991908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:34.992520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:34.998911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:34.999400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:34.999832 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:35.000533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:35.000982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:35.001403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:35.218991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:35.227704 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a1a1f91-351a-492f-95c3-7a19112a036f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1722 microversion: 2.1 time: 0.240024 Sep 29 02:19:35.228836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 336/678] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:34 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:19:36.258248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:36.259692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:36.270900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:36.271744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:36.272478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:36.273643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:36.274483 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:36.275213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:36.418875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:36.428003 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-18e8e0f9-94d3-418e-809e-a3157cefbb81 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1722 microversion: 2.1 time: 0.177852 Sep 29 02:19:36.428581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 343/679] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:36 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:37.454177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:37.454871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:37.464316 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:37.464796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:37.465238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:37.465929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:37.466427 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:37.466848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:37.603665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:37.612102 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac045605-4fac-4be1-b29a-0b22bf9289ec tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1722 microversion: 2.1 time: 0.164129 Sep 29 02:19:37.612670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 337/680] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:37 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:38.641126 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:38.642074 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:38.652145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:38.652630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:38.653059 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:38.653740 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:38.654228 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:38.654672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:38.793890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:38.805485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-367f13d5-7dce-49c7-a9d7-e188588336d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1722 microversion: 2.1 time: 0.171309 Sep 29 02:19:38.806376 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 344/681] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:38 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:39.831951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:39.832904 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:39.843678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:39.844453 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:39.845109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:39.845905 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:39.846634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:39.847082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:39.998311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:40.011152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bde10d38-3405-4465-904d-1505c33f5433 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1728 microversion: 2.1 time: 0.184858 Sep 29 02:19:40.011683 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 338/682] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:39 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:40.036787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:40.037603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:40.045534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:40.045985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:40.046479 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:40.047159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:40.047603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:40.048021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:40.131304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-73653851-b7e9-43b9-8527-107c4f2fcb38 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100688 Sep 29 02:19:40.131920 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 345/683] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:19:40 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:19:41.363277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f443ec62-50a9-463d-9526-a3f582827fe9 req-e6ad0e39-7fe5-4bbe-b0cd-6e0858d9940e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c64925-0e77-4fe1-a53f-c7104523e59d", "tag": "9dab0557-c74f-4efc-aa94-60901837db9d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:41.373197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f443ec62-50a9-463d-9526-a3f582827fe9 req-e6ad0e39-7fe5-4bbe-b0cd-6e0858d9940e service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:41.373667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f443ec62-50a9-463d-9526-a3f582827fe9 req-e6ad0e39-7fe5-4bbe-b0cd-6e0858d9940e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:41.374113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f443ec62-50a9-463d-9526-a3f582827fe9 req-e6ad0e39-7fe5-4bbe-b0cd-6e0858d9940e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:41.388066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f443ec62-50a9-463d-9526-a3f582827fe9 req-e6ad0e39-7fe5-4bbe-b0cd-6e0858d9940e service nova] Creating event network-changed:9dab0557-c74f-4efc-aa94-60901837db9d for instance 85c64925-0e77-4fe1-a53f-c7104523e59d on hv-cinder-73306 Sep 29 02:19:41.393325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f443ec62-50a9-463d-9526-a3f582827fe9 req-e6ad0e39-7fe5-4bbe-b0cd-6e0858d9940e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159905 Sep 29 02:19:41.393932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 339/684] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:19:42.309670 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:42.310630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:42.320636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:42.321439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:42.322215 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:42.323166 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:42.323611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:42.324034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:42.411986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lazy-loading 'services' on Instance uuid 122ad38e-8b7c-440d-99ab-e3c7063691ad {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:19:42.498198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5217b745-ff62-4759-b486-ae128bdfaac5 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-volume_attachments/48cab060-9137-45e7-835e-315f6ffa0593" status: 202 len: 0 microversion: 2.1 time: 0.196002 Sep 29 02:19:42.498795 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 346/685] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:19:42 2022] DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-volume_attachments/48cab060-9137-45e7-835e-315f6ffa0593 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:19:43.410476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-34ba23ee-3909-48f1-a5d6-46cac4039ded req-63089660-471d-4bb8-8189-3b259ca46b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c64925-0e77-4fe1-a53f-c7104523e59d", "tag": "9dab0557-c74f-4efc-aa94-60901837db9d"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:43.420346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-34ba23ee-3909-48f1-a5d6-46cac4039ded req-63089660-471d-4bb8-8189-3b259ca46b02 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:43.420820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-34ba23ee-3909-48f1-a5d6-46cac4039ded req-63089660-471d-4bb8-8189-3b259ca46b02 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:43.421245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-34ba23ee-3909-48f1-a5d6-46cac4039ded req-63089660-471d-4bb8-8189-3b259ca46b02 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:43.432398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-34ba23ee-3909-48f1-a5d6-46cac4039ded req-63089660-471d-4bb8-8189-3b259ca46b02 service nova] Creating event network-changed:9dab0557-c74f-4efc-aa94-60901837db9d for instance 85c64925-0e77-4fe1-a53f-c7104523e59d on hv-cinder-73306 Sep 29 02:19:43.437428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-34ba23ee-3909-48f1-a5d6-46cac4039ded req-63089660-471d-4bb8-8189-3b259ca46b02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031607 Sep 29 02:19:43.438340 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 340/686] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:19:44.699847 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d46aeaae-fb68-43b9-9fd8-2e97f2c54add tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:44.706888 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d46aeaae-fb68-43b9-9fd8-2e97f2c54add tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:44.707373 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d46aeaae-fb68-43b9-9fd8-2e97f2c54add tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:44.707806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d46aeaae-fb68-43b9-9fd8-2e97f2c54add tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:44.711454 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:44.732846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d46aeaae-fb68-43b9-9fd8-2e97f2c54add tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Going to try to stop instance {{(pid=120699) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 29 02:19:44.779856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d46aeaae-fb68-43b9-9fd8-2e97f2c54add tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action" status: 202 len: 0 microversion: 2.1 time: 0.084693 Sep 29 02:19:44.780487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 347/687] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:19:44 2022] POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:19:44.789391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:44.790147 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:44.796988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:44.797594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:44.798046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:44.798774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:44.799223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:44.799651 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:44.952003 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:44.960195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a1f027a1-0241-448f-b1c8-259201d02f16 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.175024 Sep 29 02:19:44.960750 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 341/688] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:44 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:45.997362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:45.999484 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:46.010456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:46.011362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:46.011973 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:46.012875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:46.013324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:46.013724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:46.153307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:46.161500 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-89c96d04-e9f8-4a33-86d8-c82dc6c15615 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.172548 Sep 29 02:19:46.162109 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 348/689] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:45 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:47.186868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:47.187502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:47.194291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:47.194773 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:47.195232 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:47.195922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:47.196369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:47.196791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:47.327053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:47.335260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e1ed82a1-acb9-4e29-a953-73349a1d2f94 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.153099 Sep 29 02:19:47.336805 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 342/690] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:47 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:48.358763 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:48.359356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:48.366292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:48.366751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:48.367517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:48.368214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:48.368662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:48.369089 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:48.503567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:48.511443 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2668f054-23ce-40d5-a601-8a17b50b718f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.156675 Sep 29 02:19:48.512348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 349/691] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:48 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:49.540170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:49.540986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:49.544909 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=31 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:49.550762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:49.551248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:49.551676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:49.552371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:49.552827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:49.553242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:49.696210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:49.704410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e07a2429-885a-426b-a917-451781afe641 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.170925 Sep 29 02:19:49.704988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 343/692] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:49 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:50.732174 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:50.733532 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:50.737602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=33 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:50.746463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:50.747260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:50.747942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:50.748637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:50.749084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:50.749500 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:50.895250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:50.908249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-57408ee9-19d3-4855-a7e5-6c82c460861c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.182487 Sep 29 02:19:50.909054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 350/693] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:50 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:51.939887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:51.940807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:51.952057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:51.952780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:51.953207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:51.953891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:51.954371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:51.954789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:51.957309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=80 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:19:52.093542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:52.101490 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f235dcc-c532-4d4e-ae7a-81f20e160a9a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.168551 Sep 29 02:19:52.102108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 344/694] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:51 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:53.130436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:53.131458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:53.141718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:53.142243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:53.142672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:53.143392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:53.143843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:53.144285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:53.282343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:53.295619 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5813889d-f986-49c5-9f95-17f543146352 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.171710 Sep 29 02:19:53.296622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 351/695] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:53 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:54.323605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:54.324546 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:54.335586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:54.336396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:54.337127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:54.338352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:54.339123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:54.339839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:54.480212 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:54.488088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c6a9ab45-c216-476e-a58c-1945316b9474 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.171098 Sep 29 02:19:54.488659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 345/696] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:54 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:55.159940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:55.160527 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:55.167788 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.168323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.168803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.169571 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.170111 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.170574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.197326 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c182f4f9-055f-4646-8688-463f5fa47932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/ips" status: 200 len: 148 microversion: 2.1 time: 0.043649 Sep 29 02:19:55.197912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 352/697] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:19:55 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:19:55.210840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d475c85-7044-4370-8014-477b28c6b3c2"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:55.213165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:55.219616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.220104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.220562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.221249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.221697 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.222151 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.305638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Invalid volume: volume 0d475c85-7044-4370-8014-477b28c6b3c2 is already attached to instances: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: POST /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/os-volume_attachments HTTP/1.1 Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 74 Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:19:55.307396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {"volumeAttachment": {"volumeId": "0d475c85-7044-4370-8014-477b28c6b3c2"}} Sep 29 02:19:55.308982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Invalid volume: volume 0d475c85-7044-4370-8014-477b28c6b3c2 is already attached to instances: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'server_id': 'd17caae6-a830-4120-a14f-0f01c7d6c39d', 'body': {'volumeAttachment': {'volumeId': '0d475c85-7044-4370-8014-477b28c6b3c2'}}} Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0d475c85-7044-4370-8014-477b28c6b3c2 is already attached to instances: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:55.309950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0d475c85-7044-4370-8014-477b28c6b3c2 is already attached to instances: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:19:55.311729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0d475c85-7044-4370-8014-477b28c6b3c2 is already attached to instances: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 400 to user: Invalid volume: volume 0d475c85-7044-4370-8014-477b28c6b3c2 is already attached to instances: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41c96f29-c9a6-41b4-852b-b3db20569567 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102182 Sep 29 02:19:55.313689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 346/698] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:19:55 2022] POST /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:19:55.320394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:55.320893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:55.327221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.327700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.328130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.328987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.329513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.329911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.354764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:19:55.443207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b1fd1ddb-defb-4a12-8f64-71887fe8d165 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 204 len: 0 microversion: 2.1 time: 0.126467 Sep 29 02:19:55.443812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 353/699] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:19:55 2022] DELETE /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:19:55.452588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:55.453156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:55.461392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.461873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.462338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.463024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.463474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.463895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.512632 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:55.513262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:55.520374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.520863 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.521296 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.522018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:55.522510 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:55.523058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:55.606670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:55.614875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd2335d6-ecf2-4759-a321-ded590040011 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1680 microversion: 2.1 time: 0.166274 Sep 29 02:19:55.615673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 347/700] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:55 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:55.656935 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:55.664731 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-aa22116d-daf6-4bff-8310-408fa5d3d986 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.156639 Sep 29 02:19:55.665280 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 354/701] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:55 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:56.640598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:56.641392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:56.649913 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:56.650550 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:56.651092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:56.651956 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:56.652524 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:56.653050 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:56.690594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:56.691184 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:56.698149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:56.698644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:56.699084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:56.699799 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:56.700258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:56.700689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:56.793580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:56.801611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8adb10e2-f5da-46fd-98de-3140de5d1cec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1680 microversion: 2.1 time: 0.165899 Sep 29 02:19:56.802322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 348/702] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:56 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:56.837012 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:56.845065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3daf6835-12e4-461b-9684-945335b430fd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.158545 Sep 29 02:19:56.845631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 355/703] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:56 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:57.826680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:57.827801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:57.837556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:57.838043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:57.838499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:57.839172 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:57.839652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:57.840073 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:57.867466 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:57.868535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:57.875056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:57.875542 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:57.875959 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:57.876667 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:57.877233 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:57.877654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:58.013107 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:58.021940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0934a357-2f67-451e-a05e-23fe45408451 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.158243 Sep 29 02:19:58.022632 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 356/704] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:57 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:58.067768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:58.077117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a0c19972-a2bf-421d-8fe1-e9d30322bc68 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1680 microversion: 2.1 time: 0.255823 Sep 29 02:19:58.090178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 349/705] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:57 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:58.444706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-dda919e0-52f8-45d5-8364-46b4c73ac9f7 req-2f38feb7-d044-4a7f-9433-22a288b9f4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d17caae6-a830-4120-a14f-0f01c7d6c39d", "name": "network-vif-deleted", "tag": "b456ebbb-96ea-4001-91f9-990472bb2ee7"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:19:58.457979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-dda919e0-52f8-45d5-8364-46b4c73ac9f7 req-2f38feb7-d044-4a7f-9433-22a288b9f4e0 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:58.458478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-dda919e0-52f8-45d5-8364-46b4c73ac9f7 req-2f38feb7-d044-4a7f-9433-22a288b9f4e0 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:58.458901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-dda919e0-52f8-45d5-8364-46b4c73ac9f7 req-2f38feb7-d044-4a7f-9433-22a288b9f4e0 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:58.473250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-dda919e0-52f8-45d5-8364-46b4c73ac9f7 req-2f38feb7-d044-4a7f-9433-22a288b9f4e0 service nova] Creating event network-vif-deleted:b456ebbb-96ea-4001-91f9-990472bb2ee7 for instance d17caae6-a830-4120-a14f-0f01c7d6c39d on hv-cinder-73306 Sep 29 02:19:58.482903 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-dda919e0-52f8-45d5-8364-46b4c73ac9f7 req-2f38feb7-d044-4a7f-9433-22a288b9f4e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041801 Sep 29 02:19:58.483679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 357/706] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:19:59.046640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:59.047240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:59.054334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:59.054826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:59.055263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:59.055965 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:59.056422 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:59.056850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:59.101620 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:19:59.102773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:19:59.109934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:59.111133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:59.111651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:59.112762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:59.114082 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:59.114590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:59.178217 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:19:59.178978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:19:59.181607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:19:59.183271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'fault' on Instance uuid d17caae6-a830-4120-a14f-0f01c7d6c39d {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:19:59.195405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:59.227088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-58e26b99-8f5d-49fa-938f-4db9b533a7db tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.183991 Sep 29 02:19:59.240835 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:19:59.251138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 350/707] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:59 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:19:59.252333 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fc67813c-8302-475e-bdb0-4b4db49c65cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 200 len: 1332 microversion: 2.1 time: 0.154882 Sep 29 02:19:59.252924 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 358/708] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:19:59 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 1332 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:00.259363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:00.259946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:00.267135 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:00.267747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:00.268181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:00.268900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:00.269351 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:00.269772 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:00.279555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:00.280155 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:00.288453 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:00.288955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:00.289433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:00.290385 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:00.290824 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:00.291434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:00.310272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d HTTP/1.1 Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:20:00.312246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:20:00.314137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': 'd17caae6-a830-4120-a14f-0f01c7d6c39d'} Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:20:00.315030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:20:00.316231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:00.318998 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:20:00.319976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-611aeef7-d792-4ad1-bcf9-d8469b7a3ab9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 404 len: 111 microversion: 2.1 time: 0.044474 Sep 29 02:20:00.321019 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 359/709] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:00 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:20:00.329484 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8ae8fd8f-1448-472c-b7c9-24f3b4fbdc9c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '.version_select at 0x7f404d9938b0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:00.354985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8ae8fd8f-1448-472c-b7c9-24f3b4fbdc9c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543949151" status: 202 len: 0 microversion: 2.1 time: 0.029515 Sep 29 02:20:00.355676 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 360/710] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 29 02:20:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543949151 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:00.418234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:00.427367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bef41dd9-6608-4599-861c-8a0cd04691b9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.172488 Sep 29 02:20:00.427958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 351/711] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:00 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:01.081363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:01.081887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:01.088078 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:01.088565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:01.088999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:01.089697 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:01.090214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:01.090636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:01.175797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'services' on Instance uuid 87d6d291-847b-4e09-b49e-4c5ec0dfae6c {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:01.250389 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-22f96c96-c803-4b68-a8a5-4005c214ae48 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments/0d475c85-7044-4370-8014-477b28c6b3c2" status: 202 len: 0 microversion: 2.1 time: 0.173112 Sep 29 02:20:01.251052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 361/712] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:20:01 2022] DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments/0d475c85-7044-4370-8014-477b28c6b3c2 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:01.260016 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:01.262349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:01.270299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:01.270720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:01.271157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:01.271869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:01.272320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:01.272814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:01.306689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3605eed3-cdce-44fe-86f7-1beeb44ecf3f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050880 Sep 29 02:20:01.307255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 352/713] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:01 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:01.456156 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:01.456737 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:01.463762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:01.464240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:01.464673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:01.465358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:01.465806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:01.466256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:01.597544 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:01.601246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:01.606119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-51787dc4-e1ab-4fa2-93c5-f03d0d5e1c37 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.156245 Sep 29 02:20:01.606659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 362/714] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:01 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:02.319556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:02.321718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:02.328985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.329502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.330255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.331165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.331624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.332052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.362625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e5a31b41-041c-4de9-a34b-a043486dac2c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047089 Sep 29 02:20:02.363200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 353/715] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:02 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:20:02.428434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:02.428962 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:02.436052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.436536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.436966 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.437650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.438133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.438556 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.465877 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:20:02.559547 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-48718698-6a88-432b-8fcb-673bda970c78 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 204 len: 0 microversion: 2.1 time: 0.135936 Sep 29 02:20:02.560299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 363/716] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:20:02 2022] DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:20:02.568736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:02.569347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:02.575418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.575896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.576329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.576992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.577633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.578078 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.633146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:02.633845 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:02.641524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.642121 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.642787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.643473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:02.643930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:02.644361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:02.718326 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:02.727394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe1aef5a-ee17-4256-bc54-f3b8bab72be2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1681 microversion: 2.1 time: 0.162529 Sep 29 02:20:02.728087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 354/717] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:02 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:02.786705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:02.794560 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-96d91ed0-1019-4464-b1a2-6a1978240b27 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.166649 Sep 29 02:20:02.795132 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 364/718] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:02 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:03.751310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:03.752181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:03.758729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:03.759289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:03.759795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:03.760583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:03.761105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:03.761595 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:03.818561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:03.819197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:03.825777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:03.826328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:03.826759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:03.827459 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:03.827906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:03.828323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:03.961556 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:03.969694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c618a695-7e35-4a2a-b3d8-daef35bb56cc tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.155163 Sep 29 02:20:03.970284 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 365/719] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:03 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:04.253640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:04.261729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e40ba037-a723-4ac1-9983-a63e58509453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1681 microversion: 2.1 time: 0.514379 Sep 29 02:20:04.262347 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 355/720] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:03 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1681 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:04.911698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-de1ab8d0-e67c-406b-a9db-5451835544f4 req-2891d10a-c101-4a17-b882-8b4db320579a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d6d291-847b-4e09-b49e-4c5ec0dfae6c", "name": "network-vif-deleted", "tag": "d183c6c3-e338-4c72-a436-81e93d6fc258"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:04.925681 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-de1ab8d0-e67c-406b-a9db-5451835544f4 req-2891d10a-c101-4a17-b882-8b4db320579a service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:04.926273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-de1ab8d0-e67c-406b-a9db-5451835544f4 req-2891d10a-c101-4a17-b882-8b4db320579a service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:04.926775 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-de1ab8d0-e67c-406b-a9db-5451835544f4 req-2891d10a-c101-4a17-b882-8b4db320579a service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:04.948831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-de1ab8d0-e67c-406b-a9db-5451835544f4 req-2891d10a-c101-4a17-b882-8b4db320579a service nova] Creating event network-vif-deleted:d183c6c3-e338-4c72-a436-81e93d6fc258 for instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c on hv-cinder-73306 Sep 29 02:20:04.956657 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-de1ab8d0-e67c-406b-a9db-5451835544f4 req-2891d10a-c101-4a17-b882-8b4db320579a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048126 Sep 29 02:20:04.957529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 366/721] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:04.994310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:04.995511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:05.002305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:05.003021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:05.004058 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:05.005017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:05.005578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:05.006130 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:05.149465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:05.158234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0fe7733-9321-490f-ab35-9745500692e2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.168233 Sep 29 02:20:05.158949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 356/722] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:04 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:05.287991 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:05.288690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:05.295269 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:05.295780 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:05.296190 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:05.296916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:05.297362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:05.297770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:05.335153 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:05.335644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:05.336069 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:05.336518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'fault' on Instance uuid 87d6d291-847b-4e09-b49e-4c5ec0dfae6c {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:05.380223 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:05.388098 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-88f261f3-075f-4ac8-9e89-27aeebc0674e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 200 len: 1332 microversion: 2.1 time: 0.104832 Sep 29 02:20:05.388655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 367/723] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:05 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:06.185383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:06.186322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:06.195590 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:06.196077 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:06.196573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:06.197299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:06.197770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:06.198238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:06.327419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:06.335545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-56f1b3d7-2662-4d5f-a10a-2a88ac795f55 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.156930 Sep 29 02:20:06.336114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 357/724] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:06 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:06.415363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:06.416203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:06.427237 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:06.428018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:06.428676 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:06.429784 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:06.430565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:06.431242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:06.455511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c HTTP/1.1 Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:20:06.458792 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:20:06.460242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '87d6d291-847b-4e09-b49e-4c5ec0dfae6c'} Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:20:06.461124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:20:06.462586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:06.463931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:20:06.463931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-12e54847-2347-4440-b759-b98655693661 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 404 len: 111 microversion: 2.1 time: 0.051416 Sep 29 02:20:06.463931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 368/725] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:06 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:20:06.469462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4509d949-89e2-4037-aad1-1a50ecb2b9c6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '.version_select at 0x7f404da45ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:06.474157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4509d949-89e2-4037-aad1-1a50ecb2b9c6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [7955626b-0602-4512-b1f7-0a90a4a08f37] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 29 02:20:07.360038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:07.360759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:07.368142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:07.368971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:07.369448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:07.370179 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:07.370642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:07.371068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:07.482126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-4509d949-89e2-4037-aad1-1a50ecb2b9c6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [7955626b-0602-4512-b1f7-0a90a4a08f37] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 48772. Sep 29 02:20:07.507638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4509d949-89e2-4037-aad1-1a50ecb2b9c6 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679844879" status: 202 len: 0 microversion: 2.1 time: 1.042027 Sep 29 02:20:07.508231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 358/726] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 29 02:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679844879 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:07.508553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:07.516702 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d3254240-12a0-4312-a4ef-5b70a871109c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.161305 Sep 29 02:20:07.517569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 369/727] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:07 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:20:08.186739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d19539ef-c38b-4f69-924e-1c2a7b23fbec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: .version_select at 0x7f404d899e50>, body: {"keypair": {"name": "tempest-keypair-1854311870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAFpk3tPHcu0VMV/rU7FWtOxvtuHKgjEWfbBqGiQ9e4lGuY/Pm9XXVtX+Q0dgKum9NOpdQIf7FDliYA+pNt99uhYA5hECjOoflymmMBuQXCM+Uan9ClSpTwnZLm+S5JFA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:08.203452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-d19539ef-c38b-4f69-924e-1c2a7b23fbec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:20:08.207471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-d19539ef-c38b-4f69-924e-1c2a7b23fbec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:20:08.231386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d19539ef-c38b-4f69-924e-1c2a7b23fbec tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048565 Sep 29 02:20:08.231953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 359/728] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:20:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:08.540213 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:08.540965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:08.545538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:20:08.545538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad (ip 10.222.0.61) !!! Sep 29 02:20:08.549941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:08.550626 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:08.551262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:08.552350 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:08.552759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:08.553243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:08.690894 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:08.699403 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-285be9be-9766-4269-82e9-0b8d9d5dd076 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.163233 Sep 29 02:20:08.700008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 370/729] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:08 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:09.547335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382263647", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21696cbf-ef5b-4f26-afb0-c5d58c71da44"}], "security_groups": [{"name": "tempest-securitygroup--1751941763"}], "key_name": "tempest-keypair-1854311870", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:09.665985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] validate_networks() for [('21696cbf-ef5b-4f26-afb0-c5d58c71da44', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:20:09.723467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:09.724068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:09.731728 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:09.732309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:09.732912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:09.733965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:09.734526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:09.734942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:09.874741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:09.883043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c86586cd-2aa5-461d-a031-f023646e6fb9 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1676 microversion: 2.1 time: 0.163656 Sep 29 02:20:09.883616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 371/730] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:09 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:10.066095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:20:10.066641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:20:10.067038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:20:10.067429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:20:10.067839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:20:10.077082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:10.077556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:10.077982 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:10.078738 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:10.079184 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:10.079604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:10.096501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:20:10.100833 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:20:10.113227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:20:10.115578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:20:10.162848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-46191240-8de7-43c2-9e46-0a11ad9a0db1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.620594 Sep 29 02:20:10.163494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 360/731] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:20:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:20:10.174879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-cfeaeffe-705e-4b3e-bb41-db05d9bad453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:10.175703 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-cfeaeffe-705e-4b3e-bb41-db05d9bad453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:10.228006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cfeaeffe-705e-4b3e-bb41-db05d9bad453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:10.235645 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-cfeaeffe-705e-4b3e-bb41-db05d9bad453 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1242 microversion: 2.1 time: 0.064610 Sep 29 02:20:10.236227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 372/732] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:10 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:10.906562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:10.907188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:10.914241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:10.914713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:10.915141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:10.915844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:10.916283 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:10.916701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:11.061615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:11.070121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-28551b39-ba9c-47c8-815a-ebaf5438cd74 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1653 microversion: 2.1 time: 0.168290 Sep 29 02:20:11.070707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 361/733] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:10 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1653 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:11.092504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b28e5f64-4880-4c9f-a1b7-78f66502e9a7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:11.099653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b28e5f64-4880-4c9f-a1b7-78f66502e9a7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:11.100142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b28e5f64-4880-4c9f-a1b7-78f66502e9a7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:11.100581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b28e5f64-4880-4c9f-a1b7-78f66502e9a7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:11.123882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b28e5f64-4880-4c9f-a1b7-78f66502e9a7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Going to try to start instance {{(pid=120699) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 29 02:20:11.170091 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b28e5f64-4880-4c9f-a1b7-78f66502e9a7 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action" status: 202 len: 0 microversion: 2.1 time: 0.081185 Sep 29 02:20:11.170617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 373/734] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:20:11 2022] POST /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 29 02:20:11.179382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:11.180010 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:11.186198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:11.186670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:11.187097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:11.187778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:11.188220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:11.188636 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:11.260402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:11.261076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:11.267325 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:11.267814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:11.268244 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:11.268949 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:11.269492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:11.270100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:11.323766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:11.331641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-caf15217-6085-47d3-a830-a9b38666daa8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1662 microversion: 2.1 time: 0.156471 Sep 29 02:20:11.332460 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 362/735] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:11 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:11.339650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:11.347745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d1b6eb83-5391-479a-ae9e-3d787452667b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1294 microversion: 2.1 time: 0.091678 Sep 29 02:20:11.348282 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 374/736] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:11 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:12.355426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:12.356032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:12.362889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.363377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.363851 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.365314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.365773 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.366250 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.371295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:12.371875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:12.379109 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.380176 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.380801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.381666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.382290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:12.382733 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.383427 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.602377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:12.609225 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:12.611167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7c0faab3-b476-421f-824b-65d0baba3f35 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1662 microversion: 2.1 time: 0.259587 Sep 29 02:20:12.613149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 363/737] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:12 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1662 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:12.618297 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-82043b4e-1a2b-4eec-95a5-fd9c3aef503a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1300 microversion: 2.1 time: 0.251101 Sep 29 02:20:12.619513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 375/738] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:12 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1300 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:12.623646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:12.624306 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:12.634389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.635438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.635438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.636087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.636533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.636979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.666292 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca3b2232-1493-4bed-95ae-668c2174519f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments/99d5c5b4-d478-42be-8be6-d7d34cd2257b" status: 200 len: 194 microversion: 2.20 time: 0.053159 Sep 29 02:20:12.666893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 364/739] 10.222.0.61 () {60 vars in 1454 bytes} [Thu Sep 29 02:20:12 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments/99d5c5b4-d478-42be-8be6-d7d34cd2257b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:20:12.737362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:12.737861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:12.744900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.745383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.745812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.746563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.747120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.747538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.849726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lazy-loading 'services' on Instance uuid 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:12.939221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-664d3dd2-9375-410b-8f25-000657c2535f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments/99d5c5b4-d478-42be-8be6-d7d34cd2257b" status: 202 len: 0 microversion: 2.20 time: 0.206321 Sep 29 02:20:12.939897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 376/740] 10.222.0.61 () {60 vars in 1457 bytes} [Thu Sep 29 02:20:12 2022] DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments/99d5c5b4-d478-42be-8be6-d7d34cd2257b => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:20:12.949918 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:12.953622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:12.962381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.963388 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.964091 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.965043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:12.966099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:12.966764 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:12.999505 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd2c9b50-0060-476e-b02e-c42dad869a2d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054489 Sep 29 02:20:13.005493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 365/741] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 29 02:20:12 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 29 02:20:13.587202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-ad77ca98-4400-4a52-bffe-815f0bb8c891 req-55aaa573-dd24-47e9-ae3f-38001225cf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd20e5a-93ae-453e-95fd-de7659e3f700", "tag": "ba3b2417-d526-4c9c-9ea5-f22aefaa6148"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:13.597627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-ad77ca98-4400-4a52-bffe-815f0bb8c891 req-55aaa573-dd24-47e9-ae3f-38001225cf2b service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:13.598184 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-ad77ca98-4400-4a52-bffe-815f0bb8c891 req-55aaa573-dd24-47e9-ae3f-38001225cf2b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:13.598618 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-ad77ca98-4400-4a52-bffe-815f0bb8c891 req-55aaa573-dd24-47e9-ae3f-38001225cf2b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:13.610108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-ad77ca98-4400-4a52-bffe-815f0bb8c891 req-55aaa573-dd24-47e9-ae3f-38001225cf2b service nova] Creating event network-changed:ba3b2417-d526-4c9c-9ea5-f22aefaa6148 for instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 on hv-cinder-73306 Sep 29 02:20:13.616470 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-ad77ca98-4400-4a52-bffe-815f0bb8c891 req-55aaa573-dd24-47e9-ae3f-38001225cf2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032422 Sep 29 02:20:13.616599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 377/742] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:13.640834 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:13.641682 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:13.643879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:13.644632 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:13.648642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:13.649133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:13.649568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:13.650299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:13.650753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:13.651177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:13.651277 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:13.651752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:13.652446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:13.653176 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:13.653660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:13.654066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:13.791053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:13.799123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dce89f70-6f75-400b-8899-1f5268fd26a8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1666 microversion: 2.1 time: 0.164502 Sep 29 02:20:13.799706 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 366/743] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:13 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:13.802942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:13.806762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:13.811700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-39b3ab4f-0144-4183-a429-b0fa85fca747 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.172181 Sep 29 02:20:13.812256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 378/744] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:13 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:14.017513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:14.020752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:14.027266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:14.027743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:14.028178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:14.028877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:14.029333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:14.029760 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:14.060029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ec1c27ec-da75-4bd1-903c-1f1bbb83b1b3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049549 Sep 29 02:20:14.060580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 367/745] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 29 02:20:14 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:20:14.835453 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:14.836232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:14.843989 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:14.844477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:14.844915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:14.845607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:14.846080 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:14.846492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:14.982168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:14.992563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-61fa8188-1b41-4366-aa44-d84026505681 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.161201 Sep 29 02:20:14.993130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 379/746] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:14 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:15.078801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:15.082255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:15.089809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:15.090325 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:15.090758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:15.091451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:15.091901 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:15.092320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:15.123402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a2d7fab1-75c1-4a14-a192-986a7d7c3d7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051373 Sep 29 02:20:15.123963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 368/747] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 29 02:20:15 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:15.190183 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:15.190607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:15.199664 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:15.200162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:15.200844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:15.202185 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:15.202971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:15.203655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:15.236783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:20:15.321461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a403a909-3a0e-4a22-b932-c9aeaf08a978 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 204 len: 0 microversion: 2.20 time: 0.135061 Sep 29 02:20:15.322211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 380/748] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 29 02:20:15 2022] DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 29 02:20:15.330502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:15.331106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:15.337763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:15.338301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:15.338747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:15.339408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:15.339856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:15.340274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:15.476266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:15.484562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:15.485985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:15.487168 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af49c904-ff89-420b-bd55-2c9467f1605d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.160557 Sep 29 02:20:15.487728 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 369/749] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:15 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:20:16.021832 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:16.023105 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:16.034437 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:16.036182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:16.037008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:16.037885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:16.038534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:16.039246 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:16.172688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:16.180727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2103135c-5a46-4b1d-873c-8c3efa866c85 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.166796 Sep 29 02:20:16.181264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 381/750] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:16 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:16.517262 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:16.518313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:16.525962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:16.526482 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:16.526918 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:16.527609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:16.528061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:16.528478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:16.659020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:16.668199 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:16.669624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:16.670814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fe9cd6e8-cb45-497e-91ac-6c5ca602a7db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.160072 Sep 29 02:20:16.671410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 370/751] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:16 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:17.204066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:17.204644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:17.211681 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:17.212165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:17.212597 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:17.213275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:17.213729 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:17.214163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:17.354060 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:17.361869 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-98da55d7-e783-4914-a9e4-723699cbc100 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.161819 Sep 29 02:20:17.362461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 382/752] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:17 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:17.700234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:17.701175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:17.712600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:17.713402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:17.714163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:17.715256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:17.716054 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:17.716758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:17.860273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:17.869110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:17.870954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:17.872148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e78ffe05-6d8f-47ae-b392-3f0858c8d0a4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.178466 Sep 29 02:20:17.872713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 371/753] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:17 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:18.389627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:18.390701 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:18.402075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:18.402982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:18.403843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:18.404997 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:18.405785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:18.406530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:18.560531 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:18.572359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e805232b-2381-466d-892c-17b313f48174 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.189449 Sep 29 02:20:18.572985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 383/754] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:18 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:18.897843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:18.898577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:18.905513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:18.906252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:18.906707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:18.907474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:18.907962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:18.908384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:19.037707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:19.046139 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:19.047583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:19.048753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d8dd170-df83-4d1c-8431-62c22898ea38 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.155599 Sep 29 02:20:19.049329 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 372/755] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:18 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:19.603618 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:19.604231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:19.611561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:19.612047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:19.612475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:19.613171 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:19.613622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:19.614035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:19.745017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:19.753252 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6af3e71e-a194-4652-bbf0-d6ae6701d70f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.154987 Sep 29 02:20:19.754356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 384/756] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:19 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:20.078260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:20.078947 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:20.082215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:20.086846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:20.089100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:20.089585 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:20.090056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:20.090765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:20.091211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:20.091630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:20.108133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:20.294260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:20.302847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:20.305205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:20.306666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3bbaa1b7-7e29-43e2-9200-4ebd5644392c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1722 microversion: 2.20 time: 0.234840 Sep 29 02:20:20.307337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 373/757] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:20 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:20.310202 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-0f899cdc-9d6b-4e23-a563-17bb9fe0bbec req-cd8e1bd8-d2d8-4d18-8aab-bd5d7a26a49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd20e5a-93ae-453e-95fd-de7659e3f700", "name": "network-vif-plugged", "status": "completed", "tag": "ba3b2417-d526-4c9c-9ea5-f22aefaa6148"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:20.316482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:20.320860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0f899cdc-9d6b-4e23-a563-17bb9fe0bbec req-cd8e1bd8-d2d8-4d18-8aab-bd5d7a26a49b service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:20.321339 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0f899cdc-9d6b-4e23-a563-17bb9fe0bbec req-cd8e1bd8-d2d8-4d18-8aab-bd5d7a26a49b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:20.321870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0f899cdc-9d6b-4e23-a563-17bb9fe0bbec req-cd8e1bd8-d2d8-4d18-8aab-bd5d7a26a49b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:20.333547 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-0f899cdc-9d6b-4e23-a563-17bb9fe0bbec req-cd8e1bd8-d2d8-4d18-8aab-bd5d7a26a49b service nova] Creating event network-vif-plugged:ba3b2417-d526-4c9c-9ea5-f22aefaa6148 for instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 on hv-cinder-73306 Sep 29 02:20:20.338804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-0f899cdc-9d6b-4e23-a563-17bb9fe0bbec req-cd8e1bd8-d2d8-4d18-8aab-bd5d7a26a49b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 Sep 29 02:20:20.339411 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 385/758] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:20:20.776883 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:20.777493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:20.783752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:20.784241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:20.784677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:20.785353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:20.785808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:20.786296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:21.004379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:21.012706 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e7713d1f-b3c7-4571-b5df-6d47d651f5b5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.240048 Sep 29 02:20:21.013499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 374/759] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:20 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:21.339242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:21.339696 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:21.341678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:21.347161 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:21.347647 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:21.348079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:21.348787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:21.349234 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:21.349648 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:21.390597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-b82351cc-870a-4348-aabd-336a57291497 req-ac308616-c8ca-44f3-b5f3-ccbd393e4695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1ae6d6-9e31-4e27-ae16-171415ade1c1", "name": "network-vif-deleted", "tag": "bc863b20-676e-4d92-aa33-c3d860ed5227"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:21.411105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b82351cc-870a-4348-aabd-336a57291497 req-ac308616-c8ca-44f3-b5f3-ccbd393e4695 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:21.411578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b82351cc-870a-4348-aabd-336a57291497 req-ac308616-c8ca-44f3-b5f3-ccbd393e4695 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:21.411995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-b82351cc-870a-4348-aabd-336a57291497 req-ac308616-c8ca-44f3-b5f3-ccbd393e4695 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:21.423727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-b82351cc-870a-4348-aabd-336a57291497 req-ac308616-c8ca-44f3-b5f3-ccbd393e4695 service nova] Creating event network-vif-deleted:bc863b20-676e-4d92-aa33-c3d860ed5227 for instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 on hv-cinder-73306 Sep 29 02:20:21.428758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:21.429520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-b82351cc-870a-4348-aabd-336a57291497 req-ac308616-c8ca-44f3-b5f3-ccbd393e4695 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042434 Sep 29 02:20:21.430458 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 375/760] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:20:21.438724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:21.440486 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:21.441748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-cdf6dad1-a4cd-4dbc-b8e4-4d08f1444e32 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1654 microversion: 2.20 time: 0.110335 Sep 29 02:20:21.442348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 386/761] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:21 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1654 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:20:22.037153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:22.038440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:22.044923 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.045431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.045836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.046560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.047211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.047606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.194841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:22.202972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f7e87696-5c91-4836-9f49-10f72d00351f tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1368 microversion: 2.1 time: 0.170907 Sep 29 02:20:22.203547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 376/762] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:22 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:22.467170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:22.467903 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:22.474685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.475186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.475626 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.476308 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.476768 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.477280 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.511999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.512413 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.512847 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.513295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lazy-loading 'fault' on Instance uuid 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:22.554285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:22.563136 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:22.564655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:22.565913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8c031d82-0931-498d-a87e-e5772cbcb0f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 200 len: 1370 microversion: 2.20 time: 0.102784 Sep 29 02:20:22.566511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 387/763] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:22 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:22.743552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1216782185"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:22.744087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:22.750830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.751310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.751734 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.752414 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:22.752826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:22.753240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:22.902100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.network.security_group_api [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Removing security group df4d6d47-aefe-4f19-ab95-b16b0592a626 from port 989cc0ba-4262-490c-8eed-fd84bb533af5 Sep 29 02:20:23.227238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:23.227860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:23.243397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.244232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.245300 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.246507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.247335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.248058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.269692 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41935c47-91b5-49cf-b835-a1088e0b7723 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/action" status: 202 len: 0 microversion: 2.1 time: 0.636620 Sep 29 02:20:23.270645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 377/764] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 29 02:20:22 2022] POST /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:23.424241 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:23.434212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0da70cd9-d86c-4fac-b929-a62a76beffc1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1556 microversion: 2.1 time: 0.211069 Sep 29 02:20:23.435965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 388/765] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:23 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1556 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:23.445855 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e972e02b-4c2a-46c5-baf3-25f2810ff430 req-7eabc39f-c47c-4f69-9e17-4d3b3c1b5760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:23.463723 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:23.465530 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e972e02b-4c2a-46c5-baf3-25f2810ff430 req-7eabc39f-c47c-4f69-9e17-4d3b3c1b5760 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.465909 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:23.466528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e972e02b-4c2a-46c5-baf3-25f2810ff430 req-7eabc39f-c47c-4f69-9e17-4d3b3c1b5760 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.469101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e972e02b-4c2a-46c5-baf3-25f2810ff430 req-7eabc39f-c47c-4f69-9e17-4d3b3c1b5760 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.484147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.484716 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.485354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.486294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.490706 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e972e02b-4c2a-46c5-baf3-25f2810ff430 req-7eabc39f-c47c-4f69-9e17-4d3b3c1b5760 service nova] Creating event network-changed:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:20:23.491669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.492159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.504190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e972e02b-4c2a-46c5-baf3-25f2810ff430 req-7eabc39f-c47c-4f69-9e17-4d3b3c1b5760 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059610 Sep 29 02:20:23.507162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 378/766] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:23.594299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:23.594598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9d7bee5c-54e6-4b38-b1c4-9e6db59c5903 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135104 Sep 29 02:20:23.595505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 389/767] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:20:23 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:20:23.596462 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:23.605487 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.606044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.606599 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.607649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:23.608105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:23.608527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:23.631087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] HTTP exception thrown: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Request method failure captured: Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 HTTP/1.1 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8lCqVsvNOdKq8kRPqRgmbs-7Rb-jmAaRgMNqqFwjfnQm2HMp5AWTaMExt8RfAqUNlwcKA6yamo5oXRHWS9UY1O5GQhU8NkCfp_xIQ6SoE70on7cLq7OFXtuncJqWfK3Fx0kTqqyWuBLMC_XCcuP7wG4rJ-c4edZo8sRXLZmhI6xIg Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:20:23.633440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: d0ed4854e0d449e58d09487fe8eedc2c Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:20:23.635625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '4e1ae6d6-9e31-4e27-ae16-171415ade1c1'} Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:20:23.636558 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:20:23.638170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:20:23.641110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Returning 404 to user: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:20:23.642673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6dfdf57f-952d-4b78-8f1d-a36666ad3887 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 404 len: 111 microversion: 2.20 time: 0.053698 Sep 29 02:20:23.643869 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 379/768] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:23 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:20:23.667265 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-542dca59-562e-487c-b480-a35b27ff842c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '.version_select at 0x7f404d993790>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:23.702814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-542dca59-562e-487c-b480-a35b27ff842c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920671925" status: 204 len: 0 microversion: 2.20 time: 0.053601 Sep 29 02:20:23.703696 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 390/769] 10.222.0.61 () {60 vars in 1259 bytes} [Thu Sep 29 02:20:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920671925 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 29 02:20:24.894182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-f41be865-efa4-42e8-8cda-df339c5f2890 req-7ad0e100-f634-42eb-9bcc-48b45378817f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd20e5a-93ae-453e-95fd-de7659e3f700", "tag": "ba3b2417-d526-4c9c-9ea5-f22aefaa6148"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:24.904508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f41be865-efa4-42e8-8cda-df339c5f2890 req-7ad0e100-f634-42eb-9bcc-48b45378817f service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:24.904974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f41be865-efa4-42e8-8cda-df339c5f2890 req-7ad0e100-f634-42eb-9bcc-48b45378817f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:24.905395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-f41be865-efa4-42e8-8cda-df339c5f2890 req-7ad0e100-f634-42eb-9bcc-48b45378817f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:24.917249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-f41be865-efa4-42e8-8cda-df339c5f2890 req-7ad0e100-f634-42eb-9bcc-48b45378817f service nova] Creating event network-changed:ba3b2417-d526-4c9c-9ea5-f22aefaa6148 for instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 on hv-cinder-73306 Sep 29 02:20:24.922884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-f41be865-efa4-42e8-8cda-df339c5f2890 req-7ad0e100-f634-42eb-9bcc-48b45378817f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032527 Sep 29 02:20:24.924040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 380/770] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:25.760159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-31a3d2da-0dc2-4f95-a593-8d32c056e401 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'create', calling method: .version_select at 0x7f404d75b940>, body: {"keypair": {"name": "tempest-keypair-1386330061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFooWFPXZA/4XfI5qygARrqlRuW6GT7cqIuuNSzBVkNDNabwBZD4SOTHCyb1Rd339+WOVr7mfGtw1e6cLBVnYKPudZskL2ZFpGq8zRmM6eClUQABwi3GufILwxjVK/e8wg=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:25.782666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-31a3d2da-0dc2-4f95-a593-8d32c056e401 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for project ad99e285720d41988cf2cf8f8978c313. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:20:25.787216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-31a3d2da-0dc2-4f95-a593-8d32c056e401 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for user d0ed4854e0d449e58d09487fe8eedc2c and project ad99e285720d41988cf2cf8f8978c313. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:20:25.815603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-31a3d2da-0dc2-4f95-a593-8d32c056e401 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.061077 Sep 29 02:20:25.823715 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 391/771] 10.222.0.61 () {62 vars in 1200 bytes} [Thu Sep 29 02:20:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 29 02:20:26.040351 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:26.041596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:26.047033 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-3d24e882-bc93-44a1-9f69-7b96194ccd10 req-eedf51c3-0366-4455-8972-2b9849cec5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:26.059292 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:26.062545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:26.063091 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:26.065397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3d24e882-bc93-44a1-9f69-7b96194ccd10 req-eedf51c3-0366-4455-8972-2b9849cec5ca service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:26.066433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:26.068031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:26.068180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3d24e882-bc93-44a1-9f69-7b96194ccd10 req-eedf51c3-0366-4455-8972-2b9849cec5ca service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:26.068465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:26.068607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3d24e882-bc93-44a1-9f69-7b96194ccd10 req-eedf51c3-0366-4455-8972-2b9849cec5ca service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:26.098170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-3d24e882-bc93-44a1-9f69-7b96194ccd10 req-eedf51c3-0366-4455-8972-2b9849cec5ca service nova] Creating event network-changed:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:20:26.103957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-3d24e882-bc93-44a1-9f69-7b96194ccd10 req-eedf51c3-0366-4455-8972-2b9849cec5ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067612 Sep 29 02:20:26.108359 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 392/772] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:26.185967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lazy-loading 'services' on Instance uuid 9ef3697b-fdc2-4141-aa9c-9c79452ac257 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:26.297588 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a01a90cd-b6ee-4a1c-83f7-4d284de104dd tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments/143ae93d-8bc8-4a30-9e7a-aeb441cc265a" status: 202 len: 0 microversion: 2.1 time: 0.266707 Sep 29 02:20:26.301396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 381/773] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:20:26 2022] DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments/143ae93d-8bc8-4a30-9e7a-aeb441cc265a => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:26.307704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:26.309994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:26.319383 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:26.320147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:26.320939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:26.321844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:26.322340 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:26.322764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:26.358159 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0460ac77-f6cf-4f7f-9435-02ca6bb2505f tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054752 Sep 29 02:20:26.359127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 393/774] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:26 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:20:27.312638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-627785297", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "712ee1de-b49d-47dd-8bc6-ac6e7ab6bb1a"}], "security_groups": [{"name": "tempest-securitygroup--107555402"}], "key_name": "tempest-keypair-1386330061", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:27.372491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:27.374865 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:27.381616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:27.382416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:27.382936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:27.383713 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:27.384241 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:27.384765 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:27.415008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fe5bca9b-bf42-4741-8ea3-35966abc8664 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Sep 29 02:20:27.419973 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 394/775] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:27 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:20:27.420294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] validate_networks() for [('712ee1de-b49d-47dd-8bc6-ac6e7ab6bb1a', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:20:27.814036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:20:27.814543 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:20:27.815018 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:20:27.815421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:20:27.815831 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:20:27.825067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:27.825549 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:27.825984 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:27.826746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:27.827194 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:27.827615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:27.844461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for project ad99e285720d41988cf2cf8f8978c313. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:20:27.848567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Getting quotas for user d0ed4854e0d449e58d09487fe8eedc2c and project ad99e285720d41988cf2cf8f8978c313. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:20:27.861381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:20:27.863884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:20:27.912129 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-464a2ef5-6f81-400b-a3c7-cbfe891ac49b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.604749 Sep 29 02:20:27.912862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 382/776] 10.222.0.61 () {62 vars in 1188 bytes} [Thu Sep 29 02:20:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 29 02:20:27.924955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a65e2733-8426-4977-83ba-e7806acddc57 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:27.925588 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-a65e2733-8426-4977-83ba-e7806acddc57 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:27.984916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a65e2733-8426-4977-83ba-e7806acddc57 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:27.993533 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a65e2733-8426-4977-83ba-e7806acddc57 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:27.995361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-a65e2733-8426-4977-83ba-e7806acddc57 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:27.996480 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a65e2733-8426-4977-83ba-e7806acddc57 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1281 microversion: 2.20 time: 0.075914 Sep 29 02:20:27.997046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 395/777] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:27 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:28.428166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:28.430400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:28.438174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:28.438659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:28.439108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:28.439791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:28.440241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:28.440660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:28.443269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:28.472551 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d7a5e0f-df40-4593-a6d7-ccb0ad8dfb14 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048537 Sep 29 02:20:28.473267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 383/778] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:28 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:20:28.484133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:28.484668 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:28.490789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:28.491995 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:28.492414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:28.493115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:28.493577 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:28.494040 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:28.575658 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] HTTP exception thrown: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 is not attached to volume 143ae93d-8bc8-4a30-9e7a-aeb441cc265a Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Request method failure captured: Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments/143ae93d-8bc8-4a30-9e7a-aeb441cc265a HTTP/1.1 Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP-NryM7ICEhM1xxBP5Y8qo4JlPC7PCvyxXnmDRVrqKozyjBCxVHzjo1Ov1he_keLPFx27zgc05Zhnr3cOSHR61E8EsJQspG2QJyFrp-1trIBpjqZBgUmw6L6PuN2-UwnVjdLEj9bbMEG4JaqgJ36Su50NdxzX-8BlEYE2QTzdvXF4o Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 30c052816d5544b38124d98d05b32798 Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-TestMinimumBasicScenario-1915823225 Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:20:28.578177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/30c052816d5544b38124d98d05b32798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/30c052816d5544b38124d98d05b32798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/30c052816d5544b38124d98d05b32798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_30c052816d5544b38124d98d05b32798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-TestMinimumBasicScenario-1915823225 Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 30c052816d5544b38124d98d05b32798 Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1915823225 Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-TestMinimumBasicScenario-1915823225-project Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 92d1fb3d60734f5e9bde384f96c73d30 Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-TestMinimumBasicScenario-1915823225-project Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:20:28.579526 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 is not attached to volume 143ae93d-8bc8-4a30-9e7a-aeb441cc265a Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'server_id': '9ef3697b-fdc2-4141-aa9c-9c79452ac257', 'id': '143ae93d-8bc8-4a30-9e7a-aeb441cc265a'} Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 143ae93d-8bc8-4a30-9e7a-aeb441cc265a. Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:20:28.580253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 is not attached to volume 143ae93d-8bc8-4a30-9e7a-aeb441cc265a Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 is not attached to volume 143ae93d-8bc8-4a30-9e7a-aeb441cc265a Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:28.581585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Returning 404 to user: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 is not attached to volume 143ae93d-8bc8-4a30-9e7a-aeb441cc265a {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:20:28.582833 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-40292fb3-904a-414d-ab80-3d16a4d5d9bb tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments/143ae93d-8bc8-4a30-9e7a-aeb441cc265a" status: 404 len: 154 microversion: 2.1 time: 0.099666 Sep 29 02:20:28.582833 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 396/779] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:20:28 2022] DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257/os-volume_attachments/143ae93d-8bc8-4a30-9e7a-aeb441cc265a => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:20:29.021601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:29.022160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:29.028423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:29.028877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:29.029357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:29.030136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:29.030587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:29.031002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:29.093630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:29.102110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:29.103514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:29.104799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff7d5704-7c06-4522-867d-222c2db066fe tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1333 microversion: 2.20 time: 0.087160 Sep 29 02:20:29.105356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 384/780] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:29 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:29.727188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:29.727724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:29.734912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:29.735393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:29.735821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:29.736513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:29.736981 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:29.737398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:29.763820 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:20:29.782625 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:29.847942 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b42225ec-3e13-45ad-bcd4-0d79e9d53275 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 204 len: 0 microversion: 2.1 time: 0.124361 Sep 29 02:20:29.848531 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 397/781] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:20:29 2022] DELETE /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:20:29.858887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:29.859509 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:29.865357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:29.865833 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:29.866302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:29.866990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:29.867439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:29.867839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:30.090206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:30.098795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32239b1b-9f4d-4bda-aa54-3f225f801312 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1555 microversion: 2.1 time: 0.245019 Sep 29 02:20:30.099355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 385/782] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:29 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:30.131785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:30.132592 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:30.138900 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:30.139381 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:30.139823 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:30.140520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:30.140969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:30.141381 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:30.290182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:30.301310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:30.302943 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:30.309161 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7911ba89-06f4-4a2f-8904-b3e4de49f41f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.181813 Sep 29 02:20:30.310036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 398/783] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:30 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:31.122701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:31.123241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:31.130073 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:31.130577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:31.131006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:31.131699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:31.132149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:31.132567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:31.176702 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-0f6733e0-3c31-4872-ad1c-8fcfb626ac3e req-4708be0e-3d84-4485-a169-fcfffeb45025 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:31.193374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0f6733e0-3c31-4872-ad1c-8fcfb626ac3e req-4708be0e-3d84-4485-a169-fcfffeb45025 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:31.193850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0f6733e0-3c31-4872-ad1c-8fcfb626ac3e req-4708be0e-3d84-4485-a169-fcfffeb45025 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:31.194310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-0f6733e0-3c31-4872-ad1c-8fcfb626ac3e req-4708be0e-3d84-4485-a169-fcfffeb45025 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:31.206173 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-0f6733e0-3c31-4872-ad1c-8fcfb626ac3e req-4708be0e-3d84-4485-a169-fcfffeb45025 service nova] Creating event network-changed:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:20:31.210936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-0f6733e0-3c31-4872-ad1c-8fcfb626ac3e req-4708be0e-3d84-4485-a169-fcfffeb45025 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037948 Sep 29 02:20:31.211530 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 399/784] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:20:31.336092 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:31.336793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:31.344135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:31.344623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:31.345112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:31.345811 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:31.346289 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:31.346710 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:31.429317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:31.437920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-164ea4f1-a1f0-4516-93ed-3a5ebc1e7556 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1555 microversion: 2.1 time: 0.319555 Sep 29 02:20:31.438697 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 386/785] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:31 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1555 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:31.498307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:31.507318 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:31.508852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:31.510092 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4b65f23c-a7d5-4846-88e6-b98325c73162 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.178871 Sep 29 02:20:31.510859 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 400/786] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:31 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:32.465723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:32.466768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:32.477608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:32.478471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:32.479360 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:32.480471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:32.480930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:32.481645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:32.535398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:32.536032 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:32.543558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:32.544247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:32.544836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:32.545727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:32.546204 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:32.546624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:32.551002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:32.559825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cb69c941-a2d9-4abd-93f9-70119c9cd24b tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1513 microversion: 2.1 time: 0.101444 Sep 29 02:20:32.560367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 387/787] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:32 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1513 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:32.686292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:32.694797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:32.696214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:32.697337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8efc4736-de20-4155-891b-709809b3b2d7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.166069 Sep 29 02:20:32.698052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 401/788] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:32 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:33.237001 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-4370d973-3686-4f22-bdaf-d753fa3ccd66 req-4b2f09dc-5cfa-4346-8df5-58500d493f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ef3697b-fdc2-4141-aa9c-9c79452ac257", "name": "network-vif-deleted", "tag": "989cc0ba-4262-490c-8eed-fd84bb533af5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:33.247371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4370d973-3686-4f22-bdaf-d753fa3ccd66 req-4b2f09dc-5cfa-4346-8df5-58500d493f70 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:33.248479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4370d973-3686-4f22-bdaf-d753fa3ccd66 req-4b2f09dc-5cfa-4346-8df5-58500d493f70 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:33.248931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-4370d973-3686-4f22-bdaf-d753fa3ccd66 req-4b2f09dc-5cfa-4346-8df5-58500d493f70 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:33.260224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-4370d973-3686-4f22-bdaf-d753fa3ccd66 req-4b2f09dc-5cfa-4346-8df5-58500d493f70 service nova] Creating event network-vif-deleted:989cc0ba-4262-490c-8eed-fd84bb533af5 for instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 on hv-cinder-73306 Sep 29 02:20:33.265565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-4370d973-3686-4f22-bdaf-d753fa3ccd66 req-4b2f09dc-5cfa-4346-8df5-58500d493f70 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032277 Sep 29 02:20:33.266164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 388/789] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:33.584372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:33.584997 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:33.592082 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:33.592567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:33.592998 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:33.593698 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:33.594198 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:33.594622 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:33.656507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:33.664494 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-706a5883-6283-4b49-af77-b2780377e049 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1513 microversion: 2.1 time: 0.084107 Sep 29 02:20:33.665062 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 402/790] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:33 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1513 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:33.725657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:33.726601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:33.735186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:33.735825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:33.736394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:33.737292 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:33.737885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:33.738483 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:33.871870 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:33.880538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:33.881958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:33.883086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-95444944-30b6-4ff3-8db1-1fd2ecc03952 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.163670 Sep 29 02:20:33.883641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 389/791] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:33 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:34.691212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:34.692231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:34.701696 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:34.702225 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:34.702686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:34.703364 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:34.703812 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:34.704248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:34.766669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92d1fb3d60734f5e9bde384f96c73d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30c052816d5544b38124d98d05b32798', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:34.774982 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7e298c17-102a-4c93-a17c-942a38954846 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 200 len: 1513 microversion: 2.1 time: 0.090395 Sep 29 02:20:34.775561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 403/792] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:34 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 1513 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:34.908744 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:34.909514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:34.916230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:34.917593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:34.918079 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:34.918797 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:34.919238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:34.920063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:35.134881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:35.143818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:35.145378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:35.146892 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6ef089c3-0833-4f4d-9587-cacf353a599b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.242067 Sep 29 02:20:35.147566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 390/793] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:34 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:35.803531 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:35.804096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] [instance: 9ef3697b-fdc2-4141-aa9c-9c79452ac257] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:35.812139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:35.812628 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:35.813068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:35.813766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:35.814257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:35.814739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:35.829149 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] HTTP exception thrown: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 could not be found. Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Request method failure captured: Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 HTTP/1.1 Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP-NryM7ICEhM1xxBP5Y8qo4JlPC7PCvyxXnmDRVrqKozyjBCxVHzjo1Ov1he_keLPFx27zgc05Zhnr3cOSHR61E8EsJQspG2QJyFrp-1trIBpjqZBgUmw6L6PuN2-UwnVjdLEj9bbMEG4JaqgJ36Su50NdxzX-8BlEYE2QTzdvXF4o Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 30c052816d5544b38124d98d05b32798 Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-TestMinimumBasicScenario-1915823225 Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:20:35.830872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/30c052816d5544b38124d98d05b32798"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/30c052816d5544b38124d98d05b32798"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/30c052816d5544b38124d98d05b32798"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_30c052816d5544b38124d98d05b32798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-TestMinimumBasicScenario-1915823225 Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 30c052816d5544b38124d98d05b32798 Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1915823225 Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-TestMinimumBasicScenario-1915823225-project Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 92d1fb3d60734f5e9bde384f96c73d30 Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-TestMinimumBasicScenario-1915823225-project Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 could not be found. Sep 29 02:20:35.832309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '9ef3697b-fdc2-4141-aa9c-9c79452ac257'} Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 could not be found. Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:20:35.833057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 could not be found. Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 could not be found. Sep 29 02:20:35.834476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:35.835800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Returning 404 to user: Instance 9ef3697b-fdc2-4141-aa9c-9c79452ac257 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:20:35.835800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0597a78e-0954-4e8e-83ea-0fbd5f1fc58d tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257" status: 404 len: 111 microversion: 2.1 time: 0.035313 Sep 29 02:20:35.835800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 404/794] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:35 2022] GET /compute/v2.1/servers/9ef3697b-fdc2-4141-aa9c-9c79452ac257 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:20:35.841275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5a98aac7-cbed-4c14-a792-208380f92f92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] Calling method '.version_select at 0x7f404d8b81f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:35.864781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5a98aac7-cbed-4c14-a792-208380f92f92 tempest-TestMinimumBasicScenario-1915823225 tempest-TestMinimumBasicScenario-1915823225-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2004909055" status: 202 len: 0 microversion: 2.1 time: 0.027480 Sep 29 02:20:35.865448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 391/795] 10.222.0.61 () {58 vars in 1272 bytes} [Thu Sep 29 02:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2004909055 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:36.172276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:36.173011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:36.179522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:36.180011 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:36.180446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:36.181166 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:36.181616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:36.182052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:36.326461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:36.335475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:36.336833 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:36.338076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-84b743cd-60dc-488c-9c1b-100a057be635 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.170001 Sep 29 02:20:36.339207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 405/796] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:36 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:37.363828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:37.364441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:37.371367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:37.371846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:37.372267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:37.372955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:37.373398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:37.373814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:37.510061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:37.519717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:37.521176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:37.522341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d23bb0c-2327-4591-9977-0045f419abd9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.163059 Sep 29 02:20:37.522876 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 392/797] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:37 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:20:38.406708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-ddf830c6-ac0b-42b2-8d0e-0e4e185fde53 req-05ee490c-0087-489f-a7d7-2ed2d740e7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "name": "network-vif-plugged", "status": "completed", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:38.413452 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:38.420142 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-ddf830c6-ac0b-42b2-8d0e-0e4e185fde53 req-05ee490c-0087-489f-a7d7-2ed2d740e7d1 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:38.420819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-ddf830c6-ac0b-42b2-8d0e-0e4e185fde53 req-05ee490c-0087-489f-a7d7-2ed2d740e7d1 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:38.421416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-ddf830c6-ac0b-42b2-8d0e-0e4e185fde53 req-05ee490c-0087-489f-a7d7-2ed2d740e7d1 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:38.440601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-ddf830c6-ac0b-42b2-8d0e-0e4e185fde53 req-05ee490c-0087-489f-a7d7-2ed2d740e7d1 service nova] Creating event network-vif-plugged:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:20:38.450677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-ddf830c6-ac0b-42b2-8d0e-0e4e185fde53 req-05ee490c-0087-489f-a7d7-2ed2d740e7d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044619 Sep 29 02:20:38.450677 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 406/798] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:38.548004 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:38.549151 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:38.556110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:38.556756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:38.565949 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:38.566470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:38.566920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:38.567623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:38.568261 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:38.568687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:38.765774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:38.779058 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:38.781033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:38.782566 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-191264ba-672e-4883-bd28-eb9a5985efca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.237283 Sep 29 02:20:38.783686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 393/799] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:38 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:39.809785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:39.810744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:39.817392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:39.817906 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:39.818388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:39.819106 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:39.819567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:39.819992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:39.961692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:39.972862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:39.974423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:39.975669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-41dc053e-dea6-4f4f-a427-be57274773e6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1406 microversion: 2.20 time: 0.171427 Sep 29 02:20:39.976329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 407/800] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:39 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:41.002821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:41.003406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:41.012699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:41.013288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:41.013738 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:41.014459 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:41.015455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:41.015455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:41.184114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:41.193510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:41.195074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:41.196376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc46548a-4324-435f-bd04-7e1ca523906f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1597 microversion: 2.20 time: 0.198011 Sep 29 02:20:41.197210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 394/801] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:20:40 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1597 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:20:41.222415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:41.222978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:41.231256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:41.232344 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:41.233352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:41.234461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:41.235170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:41.235801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:41.346229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7f802ccd-60f1-4707-9bc0-bc453de7dbc3 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128099 Sep 29 02:20:41.346834 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 408/802] 10.222.0.61 () {60 vars in 1316 bytes} [Thu Sep 29 02:20:41 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:20:42.305447 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-44c48b28-d4e3-4e79-9687-bc82e3ad6ca0 req-d9a648a3-381f-4e87-b84a-02a72346c1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:42.317392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-44c48b28-d4e3-4e79-9687-bc82e3ad6ca0 req-d9a648a3-381f-4e87-b84a-02a72346c1f5 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:42.318041 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-44c48b28-d4e3-4e79-9687-bc82e3ad6ca0 req-d9a648a3-381f-4e87-b84a-02a72346c1f5 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:42.318478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-44c48b28-d4e3-4e79-9687-bc82e3ad6ca0 req-d9a648a3-381f-4e87-b84a-02a72346c1f5 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:42.331088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-44c48b28-d4e3-4e79-9687-bc82e3ad6ca0 req-d9a648a3-381f-4e87-b84a-02a72346c1f5 service nova] Creating event network-changed:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:20:42.336731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-44c48b28-d4e3-4e79-9687-bc82e3ad6ca0 req-d9a648a3-381f-4e87-b84a-02a72346c1f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035098 Sep 29 02:20:42.337455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 395/803] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:49.279884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:49.280451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:49.287048 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:49.287535 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:49.287969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:49.288666 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:49.289152 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:49.289575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:49.376779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lazy-loading 'services' on Instance uuid 85c64925-0e77-4fe1-a53f-c7104523e59d {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:49.456405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ec775158-a311-4954-97b7-91737a9d526e tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments/b27e02b2-2c23-4452-8e8a-dda08623f7ea" status: 202 len: 0 microversion: 2.1 time: 0.182414 Sep 29 02:20:49.457023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 409/804] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:20:49 2022] DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments/b27e02b2-2c23-4452-8e8a-dda08623f7ea => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:49.466158 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:49.468809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:49.476873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:49.477477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:49.478081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:49.479178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:49.479606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:49.480027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:49.516471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-39042f35-4c11-4395-8782-c0744e241f7f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054703 Sep 29 02:20:49.517028 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 396/805] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:49 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:50.532239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:50.534764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:50.542434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:50.542926 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:50.543365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:50.544077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:50.544543 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:50.545002 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:50.575984 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8669374b-da75-4543-aa6b-8b1c09ebf187 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050014 Sep 29 02:20:50.576571 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 410/806] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:20:50 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:20:50.659932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:50.660489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:50.662936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:50.668289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:50.668773 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:50.669211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:50.669899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:50.670381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:50.670807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:50.697364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:20:50.777498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd22308b-36af-448f-b64d-79cdb2a768dc tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 204 len: 0 microversion: 2.1 time: 0.121208 Sep 29 02:20:50.778116 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 397/807] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:20:50 2022] DELETE /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:20:50.792534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:50.793055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:50.799615 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:50.800150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:50.800563 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:50.801253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:50.801705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:50.802158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:50.945588 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:50.956683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ad274c12-e80a-4820-bbd4-aa19e2b24f01 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1688 microversion: 2.1 time: 0.168164 Sep 29 02:20:50.957252 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 411/808] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:50 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:51.985448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:51.986205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:51.993276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:51.993785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:51.994279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:51.995019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:51.995493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:51.995934 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:52.133729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:52.142276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d7ce0847-4cfb-4283-a85b-c907a66b43e7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1688 microversion: 2.1 time: 0.163367 Sep 29 02:20:52.142844 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 398/809] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:51 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:53.168484 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:53.169403 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:53.172854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:53.178537 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:53.179021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:53.179457 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:53.180138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:53.180645 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:53.181044 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:53.317268 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:53.325498 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d1601311-a391-4378-82f0-60af56c4a8d1 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1688 microversion: 2.1 time: 0.163626 Sep 29 02:20:53.326088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 412/810] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:53 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:54.350436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:54.351381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:54.361525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:54.362302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:54.362957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:54.364045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:54.364679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:54.365282 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:54.618601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:54.628343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5d3a9262-d248-4e86-a6a9-d11073ae9cc7 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1688 microversion: 2.1 time: 0.282354 Sep 29 02:20:54.628924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 399/811] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:54 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1688 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:55.093664 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-05bf89fb-1508-4cfe-a5d9-e63921c7d97b req-1f65ee6e-faad-4dbb-9604-25ac66ed7e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c64925-0e77-4fe1-a53f-c7104523e59d", "name": "network-vif-deleted", "tag": "9dab0557-c74f-4efc-aa94-60901837db9d"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:20:55.104304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-05bf89fb-1508-4cfe-a5d9-e63921c7d97b req-1f65ee6e-faad-4dbb-9604-25ac66ed7e38 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:55.104810 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-05bf89fb-1508-4cfe-a5d9-e63921c7d97b req-1f65ee6e-faad-4dbb-9604-25ac66ed7e38 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:55.105438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-05bf89fb-1508-4cfe-a5d9-e63921c7d97b req-1f65ee6e-faad-4dbb-9604-25ac66ed7e38 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:55.117070 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-05bf89fb-1508-4cfe-a5d9-e63921c7d97b req-1f65ee6e-faad-4dbb-9604-25ac66ed7e38 service nova] Creating event network-vif-deleted:9dab0557-c74f-4efc-aa94-60901837db9d for instance 85c64925-0e77-4fe1-a53f-c7104523e59d on hv-cinder-73306 Sep 29 02:20:55.122634 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-05bf89fb-1508-4cfe-a5d9-e63921c7d97b req-1f65ee6e-faad-4dbb-9604-25ac66ed7e38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Sep 29 02:20:55.123240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 413/812] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:20:55.651731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:55.652413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:55.659252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:55.659730 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:55.660159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:55.660849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:55.661300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:55.661718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:55.677099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:55.695858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:55.696352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:55.696763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:55.697195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lazy-loading 'fault' on Instance uuid 85c64925-0e77-4fe1-a53f-c7104523e59d {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:20:55.744207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:20:55.753317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1031f9e8-e536-4fe4-b186-062b4cb7a55f tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 200 len: 1334 microversion: 2.1 time: 0.105488 Sep 29 02:20:55.753891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 400/813] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:55 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:20:56.779629 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:56.780505 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 85c64925-0e77-4fe1-a53f-c7104523e59d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:56.787938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:56.788422 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:56.788860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:56.789556 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:56.790031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:56.790471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:56.804471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] HTTP exception thrown: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d could not be found. Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Request method failure captured: Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d HTTP/1.1 Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8lXd1WxAgFWCWk8vlemYr3D-VyoxlciJ08RNEIH8neIkGUeS_aL2mTDTexl3hDbl4KKNEbUfdJO6OvXxM-rmHcjaiyK-0yPzWW_hts6neyp5myMnzA8KviWHQT9AF51PlHwPyJcuafjKvexmb72leM3wi6Ujz8-3hhxx6vXeOkrXg Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:20:56.806030 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 0df60784a8b3468ca19ec2cee1d929e5 Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d could not be found. Sep 29 02:20:56.807489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '85c64925-0e77-4fe1-a53f-c7104523e59d'} Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d could not be found. Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:20:56.808414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d could not be found. Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d could not be found. Sep 29 02:20:56.809853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:20:56.811259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Returning 404 to user: Instance 85c64925-0e77-4fe1-a53f-c7104523e59d could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:20:56.811259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-315fe2e5-ced7-4ddc-a9f4-22810a0f05b4 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d" status: 404 len: 111 microversion: 2.1 time: 0.033935 Sep 29 02:20:56.811259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 414/814] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:56 2022] GET /compute/v2.1/servers/85c64925-0e77-4fe1-a53f-c7104523e59d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:20:56.816963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ba3e89a-09e9-472e-b85b-8de9f3242c22 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '.version_select at 0x7f404d87a4c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:56.838779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ba3e89a-09e9-472e-b85b-8de9f3242c22 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-721345290" status: 202 len: 0 microversion: 2.1 time: 0.025874 Sep 29 02:20:56.839362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 401/815] 10.222.0.61 () {58 vars in 1218 bytes} [Thu Sep 29 02:20:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-721345290 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:20:59.762859 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:59.763412 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:59.771267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:59.771752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:59.772182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:59.772875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:59.773335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:59.773758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:59.801614 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:20:59.814428 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:20:59.884565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-6edf3f47-8000-44ff-9e51-39d9db5f7764 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 204 len: 0 microversion: 2.1 time: 0.127455 Sep 29 02:20:59.885175 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 415/816] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:20:59 2022] DELETE /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:20:59.894483 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:20:59.895090 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:20:59.904481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:59.904967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:59.905417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:20:59.906124 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:20:59.906580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:20:59.907010 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:00.046174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:00.054750 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ae7c263-d7f5-4959-b569-879de0197053 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1506 microversion: 2.1 time: 0.164999 Sep 29 02:21:00.055311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 402/817] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:20:59 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:01.079655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:01.080918 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:01.087299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:01.087816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:01.088230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:01.088977 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:01.089433 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:01.089867 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:01.232608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:01.253025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-76761c69-f52b-41b2-b258-6858fe3a906d tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 200 len: 1506 microversion: 2.1 time: 0.177550 Sep 29 02:21:01.253617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 416/818] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:01 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:01.293647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-da867124-014e-4fe3-a4bc-54e774cc0528 req-c90ea6bd-f620-4b15-be6d-3025b133e9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65686a2-ff71-452b-bcfe-c81dcbf741f9", "name": "network-vif-deleted", "tag": "bed0985a-cae7-47c3-8b9d-3c76eb77b4e4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:01.314359 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-da867124-014e-4fe3-a4bc-54e774cc0528 req-c90ea6bd-f620-4b15-be6d-3025b133e9f3 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:01.315241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-da867124-014e-4fe3-a4bc-54e774cc0528 req-c90ea6bd-f620-4b15-be6d-3025b133e9f3 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:01.315745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-da867124-014e-4fe3-a4bc-54e774cc0528 req-c90ea6bd-f620-4b15-be6d-3025b133e9f3 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:01.329853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-da867124-014e-4fe3-a4bc-54e774cc0528 req-c90ea6bd-f620-4b15-be6d-3025b133e9f3 service nova] Creating event network-vif-deleted:bed0985a-cae7-47c3-8b9d-3c76eb77b4e4 for instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 on hv-cinder-73306 Sep 29 02:21:01.335719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-da867124-014e-4fe3-a4bc-54e774cc0528 req-c90ea6bd-f620-4b15-be6d-3025b133e9f3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045874 Sep 29 02:21:01.336302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 403/819] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:02.281116 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:02.282052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: e65686a2-ff71-452b-bcfe-c81dcbf741f9] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:02.289813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:02.290337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:02.290774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:02.291480 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:02.291941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:02.292370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:02.306745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] HTTP exception thrown: Instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 could not be found. Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Request method failure captured: Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 HTTP/1.1 Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8lXd1WxAgFWCWk8vlemYr3D-VyoxlciJ08RNEIH8neIkGUeS_aL2mTDTexl3hDbl4KKNEbUfdJO6OvXxM-rmHcjaiyK-0yPzWW_hts6neyp5myMnzA8KviWHQT9AF51PlHwPyJcuafjKvexmb72leM3wi6Ujz8-3hhxx6vXeOkrXg Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:21:02.308397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 0df60784a8b3468ca19ec2cee1d929e5 Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 could not be found. Sep 29 02:21:02.309971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': 'e65686a2-ff71-452b-bcfe-c81dcbf741f9'} Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 could not be found. Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:02.310816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 could not be found. Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 could not be found. Sep 29 02:21:02.312893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:02.314915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Returning 404 to user: Instance e65686a2-ff71-452b-bcfe-c81dcbf741f9 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:02.314915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7e71d2f2-6968-478c-ad8d-7d188a76b939 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9" status: 404 len: 111 microversion: 2.1 time: 0.035528 Sep 29 02:21:02.314915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 417/820] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:02 2022] GET /compute/v2.1/servers/e65686a2-ff71-452b-bcfe-c81dcbf741f9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:02.321155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:02.321744 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:02.329367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:02.329885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:02.330627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:02.331220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:02.331672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:02.332091 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:02.357780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:21:02.442249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-761db6ef-6a8e-4311-bed0-61985093f259 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 204 len: 0 microversion: 2.1 time: 0.125874 Sep 29 02:21:02.442836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 404/821] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:21:02 2022] DELETE /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:21:02.452522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:02.453158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:02.459816 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:02.460294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:02.460727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:02.461411 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:02.461861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:02.462305 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:02.608338 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:02.618396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-97dbc933-b6d8-4aeb-b254-25d79c6c26d5 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1521 microversion: 2.1 time: 0.170241 Sep 29 02:21:02.618941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 418/822] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:02 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:03.651003 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:03.651665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:03.660351 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:03.661149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:03.661850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:03.662582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:03.663033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:03.663450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:03.767740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0df60784a8b3468ca19ec2cee1d929e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f88658c804e40229386a559fd2a1fa9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:03.782531 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9684e2c-61c2-4ca3-b413-23c690f71739 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 200 len: 1479 microversion: 2.1 time: 0.137618 Sep 29 02:21:03.783790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 405/823] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:03 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 1479 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:21:03.837467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-cf2b1a67-ff46-4b49-a5ec-a08e0a85fac3 req-acd6f33f-ee03-47f4-a7e5-0c5846ec2d7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcb7821-6480-46f9-a220-78d1214f7181", "name": "network-vif-deleted", "tag": "8d6a66c4-84ec-4b80-817a-4a5dfdc81a64"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:03.850868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-cf2b1a67-ff46-4b49-a5ec-a08e0a85fac3 req-acd6f33f-ee03-47f4-a7e5-0c5846ec2d7b service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:03.851341 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-cf2b1a67-ff46-4b49-a5ec-a08e0a85fac3 req-acd6f33f-ee03-47f4-a7e5-0c5846ec2d7b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:03.851767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-cf2b1a67-ff46-4b49-a5ec-a08e0a85fac3 req-acd6f33f-ee03-47f4-a7e5-0c5846ec2d7b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:03.864242 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-cf2b1a67-ff46-4b49-a5ec-a08e0a85fac3 req-acd6f33f-ee03-47f4-a7e5-0c5846ec2d7b service nova] Creating event network-vif-deleted:8d6a66c4-84ec-4b80-817a-4a5dfdc81a64 for instance 1bcb7821-6480-46f9-a220-78d1214f7181 on hv-cinder-73306 Sep 29 02:21:03.870544 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-cf2b1a67-ff46-4b49-a5ec-a08e0a85fac3 req-acd6f33f-ee03-47f4-a7e5-0c5846ec2d7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036845 Sep 29 02:21:03.871772 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 419/824] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:04.813748 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:04.814818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] [instance: 1bcb7821-6480-46f9-a220-78d1214f7181] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:04.824515 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:04.825349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:04.826058 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:04.827232 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:04.827972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:04.828691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:04.843275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] HTTP exception thrown: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 could not be found. Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Request method failure captured: Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 HTTP/1.1 Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8lXd1WxAgFWCWk8vlemYr3D-VyoxlciJ08RNEIH8neIkGUeS_aL2mTDTexl3hDbl4KKNEbUfdJO6OvXxM-rmHcjaiyK-0yPzWW_hts6neyp5myMnzA8KviWHQT9AF51PlHwPyJcuafjKvexmb72leM3wi6Ujz8-3hhxx6vXeOkrXg Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:04.844929 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8f88658c804e40229386a559fd2a1fa9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 8f88658c804e40229386a559fd2a1fa9 Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1696685857 Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 0df60784a8b3468ca19ec2cee1d929e5 Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1696685857-project Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 could not be found. Sep 29 02:21:04.846752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '1bcb7821-6480-46f9-a220-78d1214f7181'} Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 could not be found. Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:04.847626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 could not be found. Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 could not be found. Sep 29 02:21:04.849097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:04.850421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] Returning 404 to user: Instance 1bcb7821-6480-46f9-a220-78d1214f7181 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:04.850421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6df32634-c026-4b66-8b6a-c002440cf930 tempest-ServerRescueNegativeTestJSON-1696685857 tempest-ServerRescueNegativeTestJSON-1696685857-project] 10.222.0.61 "GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181" status: 404 len: 111 microversion: 2.1 time: 0.038892 Sep 29 02:21:04.850421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 406/825] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:04 2022] GET /compute/v2.1/servers/1bcb7821-6480-46f9-a220-78d1214f7181 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:09.545507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-161e9ea5-392e-45f9-8f4f-b902e314b392 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Action: 'create', calling method: .version_select at 0x7f404d7be430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1227412340"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:09.862882 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-161e9ea5-392e-45f9-8f4f-b902e314b392 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.468831 Sep 29 02:21:09.863555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 420/826] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Sep 29 02:21:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 471 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 29 02:21:09.876822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb4abd68-a2b9-4b27-8ae8-4001b482fc2e tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d899940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:09.927371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb4abd68-a2b9-4b27-8ae8-4001b482fc2e tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 200 len: 345 microversion: 2.1 time: 0.054725 Sep 29 02:21:09.927928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 407/827] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:21:09 2022] GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:10.945208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d7281ded-2087-4960-b6fb-047ab2e29cef tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d8eda60>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:10.993034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d7281ded-2087-4960-b6fb-047ab2e29cef tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 200 len: 346 microversion: 2.1 time: 0.054111 Sep 29 02:21:10.993599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 421/828] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:21:10 2022] GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:11.007478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0005f9e1-1857-4e85-a6ea-464f2c6fd65b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Action: 'create', calling method: .version_select at 0x7f404d8650d0>, body: {"snapshot": {"volume_id": "6b0216e8-207c-41c1-a2d7-5730f6fb00a6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1354062530"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:11.167962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0005f9e1-1857-4e85-a6ea-464f2c6fd65b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.164822 Sep 29 02:21:11.168565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 408/829] 10.222.0.61 () {60 vars in 1162 bytes} [Thu Sep 29 02:21:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:11.180490 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-a0385c63-ed96-4174-ade0-da7d1e261314 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d877670>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:11.210322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-a0385c63-ed96-4174-ade0-da7d1e261314 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.033905 Sep 29 02:21:11.210908 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 422/830] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:11 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:11.223016 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ed062ec-cef2-4037-a287-baaa3b94f4d0 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d8b0d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:11.253847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ed062ec-cef2-4037-a287-baaa3b94f4d0 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034776 Sep 29 02:21:11.254444 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 409/831] 10.222.0.61 () {58 vars in 1140 bytes} [Thu Sep 29 02:21:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:11.265693 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-bad87517-1b8e-4e3a-ab0d-80c87f727566 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d7be3a0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:11.296370 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-bad87517-1b8e-4e3a-ab0d-80c87f727566 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.034468 Sep 29 02:21:11.296922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 423/832] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:11 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:12.312746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-285ab672-3d3e-4978-a398-a5b53bed368f tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d87da60>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:12.355932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-285ab672-3d3e-4978-a398-a5b53bed368f tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.049244 Sep 29 02:21:12.356688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 410/833] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:12 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:13.375434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e820baa5-0929-4d4f-b9d0-bd9bd57aa6de tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d755af0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:13.420431 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e820baa5-0929-4d4f-b9d0-bd9bd57aa6de tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.052656 Sep 29 02:21:13.420993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 424/834] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:13 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:14.439207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-54e96304-3f75-4944-8c67-d19dff4a50b7 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f40512821f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:14.473567 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-54e96304-3f75-4944-8c67-d19dff4a50b7 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.041599 Sep 29 02:21:14.474386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 411/835] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:14 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:15.485875 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:15.487138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:15.493749 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-73ed8917-682d-466b-b4d2-622f1feb71bf tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d79bdc0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:15.525881 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-73ed8917-682d-466b-b4d2-622f1feb71bf tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.041574 Sep 29 02:21:15.526472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 425/836] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:15 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:16.538021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:16.539541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:16.544087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-322d09f1-61a4-4ffb-a2ac-f8841d8b5225 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d87db80>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:16.574834 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-322d09f1-61a4-4ffb-a2ac-f8841d8b5225 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 288 microversion: 2.1 time: 0.038316 Sep 29 02:21:16.575406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 412/837] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:16 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:16.587630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2970dfc5-a958-49de-bc5a-ac95d281719f tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d8ed820>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:16.653031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2970dfc5-a958-49de-bc5a-ac95d281719f tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 202 len: 0 microversion: 2.1 time: 0.069964 Sep 29 02:21:16.653612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 426/838] 10.222.0.61 () {58 vars in 1254 bytes} [Thu Sep 29 02:21:16 2022] DELETE /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:21:16.662277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3055e646-5e54-41bb-a72b-1dfb9cc78a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d9eb430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:16.693894 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3055e646-5e54-41bb-a72b-1dfb9cc78a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 200 len: 287 microversion: 2.1 time: 0.035728 Sep 29 02:21:16.694689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 413/839] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:16 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:17.713468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-15011b76-8383-4de5-8825-90fd97203a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d8df550>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:17.741010 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-15011b76-8383-4de5-8825-90fd97203a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] HTTP exception thrown: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-15011b76-8383-4de5-8825-90fd97203a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Request method failure captured: Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 HTTP/1.1 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNQEVSlBlQBOmjDMrSVH2sErD1m_3gva8SEE8CHaSdneYvM-WrnceLFv7XU1eACbFD36BU3W0LY2V1LmWg4jW4h_4YkRsMpsKziZ5_WDGvSkcPKvLAf95G0bD0PO8T-IJCxekDUxU7cUis-yKT7HEk4QhNrCBRXkfeggQfG0iVNThCb4 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:21:17.745143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6207fc27f8546028eced464da11be94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6207fc27f8546028eced464da11be94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a86492e006284f44af99d08ef7e74559 Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '779ea9e2-3d53-4707-a7c6-7f4244ef0fa7'} Sep 29 02:21:17.746695 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. (HTTP 404) (Request-ID: req-66bff834-7109-4d74-ae38-683429fc5348) Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.747688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:17.750034 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 29 02:21:17.751574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-15011b76-8383-4de5-8825-90fd97203a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Returning 404 to user: Snapshot 779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:17.753143 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-15011b76-8383-4de5-8825-90fd97203a5b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7" status: 404 len: 111 microversion: 2.1 time: 0.040182 Sep 29 02:21:17.754218 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 427/840] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 29 02:21:17 2022] GET /compute/v2.1/os-snapshots/779ea9e2-3d53-4707-a7c6-7f4244ef0fa7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:17.756350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ca3e5311-17f4-41f7-bf6e-e7d6cc61b8c3 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d8b01f0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:17.828132 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ca3e5311-17f4-41f7-bf6e-e7d6cc61b8c3 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 202 len: 0 microversion: 2.1 time: 0.076037 Sep 29 02:21:17.828702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 414/841] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:21:17 2022] DELETE /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:21:17.837475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9c976a2f-afdb-41df-a5e1-a4185761880b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d95b670>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:17.885786 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9c976a2f-afdb-41df-a5e1-a4185761880b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 200 len: 345 microversion: 2.1 time: 0.052516 Sep 29 02:21:17.886401 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 428/842] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:21:17 2022] GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:18.905851 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7a99dd5-1c4c-4c53-aa0c-6d72339c791b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404db60af0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:18.939554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b7a99dd5-1c4c-4c53-aa0c-6d72339c791b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] HTTP exception thrown: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7a99dd5-1c4c-4c53-aa0c-6d72339c791b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Request method failure captured: Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 HTTP/1.1 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQEVSlBlQBOmjDMrSVH2sErD1m_3gva8SEE8CHaSdneYvM-WrnceLFv7XU1eACbFD36BU3W0LY2V1LmWg4jW4h_4YkRsMpsKziZ5_WDGvSkcPKvLAf95G0bD0PO8T-IJCxekDUxU7cUis-yKT7HEk4QhNrCBRXkfeggQfG0iVNThCb4 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:18.942799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6207fc27f8546028eced464da11be94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6207fc27f8546028eced464da11be94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a86492e006284f44af99d08ef7e74559 Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '6b0216e8-207c-41c1-a2d7-5730f6fb00a6'} Sep 29 02:21:18.944305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. (HTTP 404) (Request-ID: req-044a7ba9-3230-4802-aaf6-beae4b522f21) Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:18.945247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:18.946712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 29 02:21:18.948150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7a99dd5-1c4c-4c53-aa0c-6d72339c791b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Returning 404 to user: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7a99dd5-1c4c-4c53-aa0c-6d72339c791b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 404 len: 109 microversion: 2.1 time: 0.045535 Sep 29 02:21:18.949963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 415/843] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:21:18 2022] GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:18.954804 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-820daac7-a35d-4988-a4a3-c75df67929f9 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f404d9c5700>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:18.986893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-820daac7-a35d-4988-a4a3-c75df67929f9 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] HTTP exception thrown: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-820daac7-a35d-4988-a4a3-c75df67929f9 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Request method failure captured: Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 HTTP/1.1 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNQEVSlBlQBOmjDMrSVH2sErD1m_3gva8SEE8CHaSdneYvM-WrnceLFv7XU1eACbFD36BU3W0LY2V1LmWg4jW4h_4YkRsMpsKziZ5_WDGvSkcPKvLAf95G0bD0PO8T-IJCxekDUxU7cUis-yKT7HEk4QhNrCBRXkfeggQfG0iVNThCb4 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:21:18.989192 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6207fc27f8546028eced464da11be94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6207fc27f8546028eced464da11be94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a86492e006284f44af99d08ef7e74559 Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '6b0216e8-207c-41c1-a2d7-5730f6fb00a6'} Sep 29 02:21:18.990815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. (HTTP 404) (Request-ID: req-7de76aea-89b8-4a61-91bf-f2cc7fd22b1d) Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:18.991752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 29 02:21:18.993272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 29 02:21:18.994830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-820daac7-a35d-4988-a4a3-c75df67929f9 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Returning 404 to user: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-820daac7-a35d-4988-a4a3-c75df67929f9 tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 404 len: 109 microversion: 2.1 time: 0.040325 Sep 29 02:21:18.996253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 429/844] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:21:18 2022] DELETE /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:18.999984 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d89ffef6-6dbd-4479-b8fc-dd62335e216b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Calling method '.version_select at 0x7f4051282ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:19.032849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-d89ffef6-6dbd-4479-b8fc-dd62335e216b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] HTTP exception thrown: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d89ffef6-6dbd-4479-b8fc-dd62335e216b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Request method failure captured: Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 HTTP/1.1 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQEVSlBlQBOmjDMrSVH2sErD1m_3gva8SEE8CHaSdneYvM-WrnceLFv7XU1eACbFD36BU3W0LY2V1LmWg4jW4h_4YkRsMpsKziZ5_WDGvSkcPKvLAf95G0bD0PO8T-IJCxekDUxU7cUis-yKT7HEk4QhNrCBRXkfeggQfG0iVNThCb4 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:19.034814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6207fc27f8546028eced464da11be94"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6207fc27f8546028eced464da11be94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6207fc27f8546028eced464da11be94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: f6207fc27f8546028eced464da11be94 Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141914045 Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a86492e006284f44af99d08ef7e74559 Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141914045-project Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '6b0216e8-207c-41c1-a2d7-5730f6fb00a6'} Sep 29 02:21:19.036309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. (HTTP 404) (Request-ID: req-26f9ed9b-8f18-4497-8184-7c265293cfda) Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:19.037202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:19.038494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 29 02:21:19.039802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d89ffef6-6dbd-4479-b8fc-dd62335e216b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] Returning 404 to user: Volume 6b0216e8-207c-41c1-a2d7-5730f6fb00a6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d89ffef6-6dbd-4479-b8fc-dd62335e216b tempest-VolumesSnapshotsTestJSON-2141914045 tempest-VolumesSnapshotsTestJSON-2141914045-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6" status: 404 len: 109 microversion: 2.1 time: 0.040574 Sep 29 02:21:19.041118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 416/845] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:21:18 2022] GET /compute/v2.1/os-volumes/6b0216e8-207c-41c1-a2d7-5730f6fb00a6 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:20.486056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-125820a0-e8d4-470f-acf2-a8e4b79d2186 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Action: 'create', calling method: .version_select at 0x7f404d8eddc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1469988335", "metadata": {"Type": "work"}}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-125820a0-e8d4-470f-acf2-a8e4b79d2186 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Request method failure captured: Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 122 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNQEgIedHc078hw1M395Phc60NoGOyhHMHjYWQKRs6q7bddO7ObjH6cVPtqbjoLaqqp1pSzgTCj_-IMhFAGRuZ_QoQVC0T968y0lq6ma8tucgekZqAyREF8_xiAl-nT07IX9muzfR9ciEmBlxhkl5-dYLLWYj9SLWPxKLE8_RTGYYSW4 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:21:20.501045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc6e32ff424f435d89bef15929d19218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: ec579cfaecca4fb18679e8b7ea07b1e5 Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1469988335", "metadata": {"Type": "work"}}} Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: Sep 29 02:21:20.502661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1469988335', 'metadata': {'Type': 'work'}}}} Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise error Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi '#$%' Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:20.503785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 29 02:21:20.505473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 29 02:21:20.507214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 29 02:21:20.507214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.507214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-125820a0-e8d4-470f-acf2-a8e4b79d2186 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:20.507214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-125820a0-e8d4-470f-acf2-a8e4b79d2186 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143724 Sep 29 02:21:20.507214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 430/846] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 29 02:21:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:21:20.515888 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ff0e0ba-9a00-48a7-82a0-c307829a06c2 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Action: 'create', calling method: .version_select at 0x7f404d8b8e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-222974242", "metadata": {"Type": "work"}}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ff0e0ba-9a00-48a7-82a0-c307829a06c2 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Request method failure captured: Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 119 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQEgIedHc078hw1M395Phc60NoGOyhHMHjYWQKRs6q7bddO7ObjH6cVPtqbjoLaqqp1pSzgTCj_-IMhFAGRuZ_QoQVC0T968y0lq6ma8tucgekZqAyREF8_xiAl-nT07IX9muzfR9ciEmBlxhkl5-dYLLWYj9SLWPxKLE8_RTGYYSW4 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:20.522885 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc6e32ff424f435d89bef15929d19218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: ec579cfaecca4fb18679e8b7ea07b1e5 Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-222974242", "metadata": {"Type": "work"}}} Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: Sep 29 02:21:20.524405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-222974242', 'metadata': {'Type': 'work'}}}} Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise error Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi '0' Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:20.525441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 29 02:21:20.527087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 29 02:21:20.528336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 29 02:21:20.528336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.528336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1ff0e0ba-9a00-48a7-82a0-c307829a06c2 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:20.528336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1ff0e0ba-9a00-48a7-82a0-c307829a06c2 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015710 Sep 29 02:21:20.528336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 417/847] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 29 02:21:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:21:20.534502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4dda1745-4ef8-4dae-9f9d-d74d10703206 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Action: 'create', calling method: .version_select at 0x7f404d79b430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1895449653", "metadata": {"Type": "work"}}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4dda1745-4ef8-4dae-9f9d-d74d10703206 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Request method failure captured: Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 119 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNQEgIedHc078hw1M395Phc60NoGOyhHMHjYWQKRs6q7bddO7ObjH6cVPtqbjoLaqqp1pSzgTCj_-IMhFAGRuZ_QoQVC0T968y0lq6ma8tucgekZqAyREF8_xiAl-nT07IX9muzfR9ciEmBlxhkl5-dYLLWYj9SLWPxKLE8_RTGYYSW4 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:21:20.539346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc6e32ff424f435d89bef15929d19218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: ec579cfaecca4fb18679e8b7ea07b1e5 Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1895449653", "metadata": {"Type": "work"}}} Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: Sep 29 02:21:20.540850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1895449653', 'metadata': {'Type': 'work'}}}} Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise error Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi '' Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:20.541987 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 29 02:21:20.543616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 29 02:21:20.544752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 29 02:21:20.544752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.544752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4dda1745-4ef8-4dae-9f9d-d74d10703206 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:20.544752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4dda1745-4ef8-4dae-9f9d-d74d10703206 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010926 Sep 29 02:21:20.544752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 431/848] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 29 02:21:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:21:20.552954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-527e22a1-1da9-4c3f-9789-86748e7d6b67 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Calling method '.version_select at 0x7f404da10940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:20.582861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-527e22a1-1da9-4c3f-9789-86748e7d6b67 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] HTTP exception thrown: Volume tempest-invalid-1975494389 could not be found. Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-527e22a1-1da9-4c3f-9789-86748e7d6b67 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Request method failure captured: Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1975494389 HTTP/1.1 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQEgIedHc078hw1M395Phc60NoGOyhHMHjYWQKRs6q7bddO7ObjH6cVPtqbjoLaqqp1pSzgTCj_-IMhFAGRuZ_QoQVC0T968y0lq6ma8tucgekZqAyREF8_xiAl-nT07IX9muzfR9ciEmBlxhkl5-dYLLWYj9SLWPxKLE8_RTGYYSW4 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:20.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc6e32ff424f435d89bef15929d19218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: ec579cfaecca4fb18679e8b7ea07b1e5 Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Volume tempest-invalid-1975494389 could not be found. Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': 'tempest-invalid-1975494389'} Sep 29 02:21:20.586878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1975494389 could not be found. (HTTP 404) (Request-ID: req-5dde467f-5b2c-4f52-b5bd-764e178d795a) Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.587820 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 29 02:21:20.589321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1975494389 could not be found. Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:20.590936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1975494389 could not be found. Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1975494389 could not be found. Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-527e22a1-1da9-4c3f-9789-86748e7d6b67 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Returning 404 to user: Volume tempest-invalid-1975494389 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-527e22a1-1da9-4c3f-9789-86748e7d6b67 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1975494389" status: 404 len: 99 microversion: 2.1 time: 0.038456 Sep 29 02:21:20.592406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 418/849] 10.222.0.61 () {58 vars in 1218 bytes} [Thu Sep 29 02:21:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1975494389 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 29 02:21:20.596287 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f125d3fc-3cab-4ce6-8b19-a8605897839a tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003909 Sep 29 02:21:20.596778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 432/850] 10.222.0.61 () {58 vars in 1140 bytes} [Thu Sep 29 02:21:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 29 02:21:20.605195 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f58192c-cd6c-46a0-9c27-12b474d42cb1 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003781 Sep 29 02:21:20.605673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 419/851] 10.222.0.61 () {58 vars in 1137 bytes} [Thu Sep 29 02:21:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 29 02:21:20.613681 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-35351f9c-0715-4c94-8ca5-b1c947940cb3 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Calling method '.version_select at 0x7f404d9c8ca0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:20.643205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-35351f9c-0715-4c94-8ca5-b1c947940cb3 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] HTTP exception thrown: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-35351f9c-0715-4c94-8ca5-b1c947940cb3 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Request method failure captured: Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/os-volumes/7e4a552b-fc89-4952-a72f-50c53765bcca HTTP/1.1 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNQEgIedHc078hw1M395Phc60NoGOyhHMHjYWQKRs6q7bddO7ObjH6cVPtqbjoLaqqp1pSzgTCj_-IMhFAGRuZ_QoQVC0T968y0lq6ma8tucgekZqAyREF8_xiAl-nT07IX9muzfR9ciEmBlxhkl5-dYLLWYj9SLWPxKLE8_RTGYYSW4 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:21:20.645214 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc6e32ff424f435d89bef15929d19218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: ec579cfaecca4fb18679e8b7ea07b1e5 Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '7e4a552b-fc89-4952-a72f-50c53765bcca'} Sep 29 02:21:20.649203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. (HTTP 404) (Request-ID: req-3a312da3-eb5d-444d-8561-0c0e32442d1d) Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.650114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 29 02:21:20.651501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 29 02:21:20.653160 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-35351f9c-0715-4c94-8ca5-b1c947940cb3 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Returning 404 to user: Volume 7e4a552b-fc89-4952-a72f-50c53765bcca could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-35351f9c-0715-4c94-8ca5-b1c947940cb3 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/7e4a552b-fc89-4952-a72f-50c53765bcca" status: 404 len: 109 microversion: 2.1 time: 0.036469 Sep 29 02:21:20.654656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 433/852] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:21:20 2022] DELETE /compute/v2.1/os-volumes/7e4a552b-fc89-4952-a72f-50c53765bcca => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:20.657217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7890d62d-a6a6-4afa-8f02-5fb3f8e526d7 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Calling method '.version_select at 0x7f404d8f9d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:20.686971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7890d62d-a6a6-4afa-8f02-5fb3f8e526d7 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] HTTP exception thrown: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7890d62d-a6a6-4afa-8f02-5fb3f8e526d7 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Request method failure captured: Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/211752e2-fcb1-45e3-909d-bba822600492 HTTP/1.1 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQEgIedHc078hw1M395Phc60NoGOyhHMHjYWQKRs6q7bddO7ObjH6cVPtqbjoLaqqp1pSzgTCj_-IMhFAGRuZ_QoQVC0T968y0lq6ma8tucgekZqAyREF8_xiAl-nT07IX9muzfR9ciEmBlxhkl5-dYLLWYj9SLWPxKLE8_RTGYYSW4 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:20.688914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc6e32ff424f435d89bef15929d19218"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc6e32ff424f435d89bef15929d19218"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: dc6e32ff424f435d89bef15929d19218 Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-701615054 Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: ec579cfaecca4fb18679e8b7ea07b1e5 Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-701615054-project Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '211752e2-fcb1-45e3-909d-bba822600492'} Sep 29 02:21:20.690552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. (HTTP 404) (Request-ID: req-d4f3bd84-1eda-4be1-847f-81c3cf5b7ba2) Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.691499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:21:20.692821 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 29 02:21:20.694202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7890d62d-a6a6-4afa-8f02-5fb3f8e526d7 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] Returning 404 to user: Volume 211752e2-fcb1-45e3-909d-bba822600492 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7890d62d-a6a6-4afa-8f02-5fb3f8e526d7 tempest-VolumesNegativeTest-701615054 tempest-VolumesNegativeTest-701615054-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/211752e2-fcb1-45e3-909d-bba822600492" status: 404 len: 109 microversion: 2.1 time: 0.037440 Sep 29 02:21:20.695575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 420/853] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:21:20 2022] GET /compute/v2.1/os-volumes/211752e2-fcb1-45e3-909d-bba822600492 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 29 02:21:30.540828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:30.543205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:30.550113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:30.550607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:30.551050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:30.551755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:30.552239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:30.552684 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:30.582522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-91bba009-402a-4251-9a01-75ba0c64f2dd tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047263 Sep 29 02:21:30.583569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 434/854] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:21:30 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:21:30.652305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:30.652888 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:30.662677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:30.663395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:30.663998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:30.665036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:30.665699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:30.666217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:30.693262 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:21:30.781279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-69035bbd-6f54-4b82-8707-a1d26ca4fe72 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 204 len: 0 microversion: 2.1 time: 0.136504 Sep 29 02:21:30.782409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 421/855] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:21:30 2022] DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:21:30.791497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:30.792103 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:30.798581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:30.799075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:30.799506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:30.800168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:30.800623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:30.801043 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:30.942846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:30.954719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-02a4a069-6d56-4055-b526-e4a907067361 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1672 microversion: 2.1 time: 0.167008 Sep 29 02:21:30.955481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 435/856] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:30 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:21:31.981498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:31.982219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:31.989639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:31.990241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:31.990687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:31.991380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:31.991817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:31.992236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:32.132344 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:32.140166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-34dd0d4c-3487-4205-acd6-19765a23bd33 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1672 microversion: 2.1 time: 0.164007 Sep 29 02:21:32.140923 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 422/857] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:31 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:33.164743 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:33.166125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:33.176862 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:33.178566 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:33.179217 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:33.186938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:33.187635 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:33.188083 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:33.220561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1f026f05-e173-4ac1-92e2-0775de6dc3db req-d94843d8-20f5-448f-b87a-33124c1f5002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122ad38e-8b7c-440d-99ab-e3c7063691ad", "name": "network-vif-deleted", "tag": "870d1dee-af78-44b4-8d9b-36d459c3e5c4"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:33.248053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1f026f05-e173-4ac1-92e2-0775de6dc3db req-d94843d8-20f5-448f-b87a-33124c1f5002 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:33.248536 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1f026f05-e173-4ac1-92e2-0775de6dc3db req-d94843d8-20f5-448f-b87a-33124c1f5002 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:33.248967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1f026f05-e173-4ac1-92e2-0775de6dc3db req-d94843d8-20f5-448f-b87a-33124c1f5002 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:33.271380 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1f026f05-e173-4ac1-92e2-0775de6dc3db req-d94843d8-20f5-448f-b87a-33124c1f5002 service nova] Creating event network-vif-deleted:870d1dee-af78-44b4-8d9b-36d459c3e5c4 for instance 122ad38e-8b7c-440d-99ab-e3c7063691ad on hv-cinder-73306 Sep 29 02:21:33.281122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1f026f05-e173-4ac1-92e2-0775de6dc3db req-d94843d8-20f5-448f-b87a-33124c1f5002 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064685 Sep 29 02:21:33.282460 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 423/858] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:33.338139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:33.358380 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b45ca018-0e8d-4992-bf4d-fbe1252ffb31 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 200 len: 1606 microversion: 2.1 time: 0.189872 Sep 29 02:21:33.358380 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 436/859] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:33 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 1606 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:34.378266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:34.378986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:34.385215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:34.385702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:34.386166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:34.386857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:34.387290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:34.387734 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:34.401768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] HTTP exception thrown: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Request method failure captured: Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad HTTP/1.1 Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8eOrsiwhrlXV7KBrjfHN_v1unsD6tq2BBdrhLhPG4qZDLBFn5YCxnGZwK6nJi9oDGvQu8UHWBbmQYa48QUQDRrzHkl100xSmAJ4kI3hzFyHQvx-ytgxkOdz7CWDcSPc7V_-F1DOq93hguaV6qDXxtrBCsObHDfx0d-PAPRH2XfhOw Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:21:34.403449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 480c3f60b5e14b5f93e5dc921694aee4 Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:21:34.409089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '122ad38e-8b7c-440d-99ab-e3c7063691ad'} Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:21:34.410230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:21:34.411456 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:21:34.412582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Returning 404 to user: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:21:34.412582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-48a134e5-0b53-4868-8123-e23e46c3fe09 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 404 len: 111 microversion: 2.1 time: 0.031863 Sep 29 02:21:34.412582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 424/860] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:34 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:21:34.413787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2a17679c-c428-4789-bdb8-3cac2300ea8a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '.version_select at 0x7f404d79b1f0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:34.435546 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2a17679c-c428-4789-bdb8-3cac2300ea8a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378693663" status: 202 len: 0 microversion: 2.1 time: 0.025144 Sep 29 02:21:34.436382 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 437/861] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 29 02:21:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378693663 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:21:35.088118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b9006e8-f7a8-47b0-96fc-526e9141e40a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: .version_select at 0x7f404d865430>, body: {"keypair": {"name": "tempest-keypair-106415331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTbUfVB0RycQikqwbjWYHn97SrwHZgikFjcecqysFunrk8BAEjdpj/JetWrYqB4W65jf1mJXAh0D4KnscCyUKaQj7Ufq25rL7a7klEISMijeiHp3qz0ExGYDuVVrdgu3w=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:35.104081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-6b9006e8-f7a8-47b0-96fc-526e9141e40a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:21:35.107854 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-6b9006e8-f7a8-47b0-96fc-526e9141e40a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for user 480c3f60b5e14b5f93e5dc921694aee4 and project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:21:35.131693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b9006e8-f7a8-47b0-96fc-526e9141e40a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047415 Sep 29 02:21:35.132536 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 425/862] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:21:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:36.511682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1004813651", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "106d8127-c1ae-4a0b-8b5c-0698e340d643"}], "security_groups": [{"name": "tempest-securitygroup--828350006"}], "key_name": "tempest-keypair-106415331", "user_data": "}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:36.622482 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] validate_networks() for [('106d8127-c1ae-4a0b-8b5c-0698e340d643', None, None, None, None, None)] {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:21:37.140854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Flavor limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:21:37.141406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Image limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:21:37.141955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Flavor pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:21:37.142493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Image pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:21:37.142910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:21:37.152028 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:37.152569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:37.153004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:37.153727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:37.154232 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:37.154656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:37.172372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:21:37.182317 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Getting quotas for user 480c3f60b5e14b5f93e5dc921694aee4 and project e72ef47313ef4a8582a9e060d5597fc0. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:21:37.195831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Going to run 1 instances... {{(pid=120699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:21:37.198335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:21:37.249279 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8dede199-1c38-40dd-a677-f17a52f500ca tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.742367 Sep 29 02:21:37.250564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 438/863] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:21:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:21:37.262580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3ae836e1-c0eb-4ac9-9e05-43160e560130 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:37.263162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3ae836e1-c0eb-4ac9-9e05-43160e560130 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:37.333912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3ae836e1-c0eb-4ac9-9e05-43160e560130 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:37.343458 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3ae836e1-c0eb-4ac9-9e05-43160e560130 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1237 microversion: 2.1 time: 0.085160 Sep 29 02:21:37.344338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 426/864] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:37 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:38.366751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:38.367306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:38.373976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:38.374501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:38.375314 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:38.376021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:38.376556 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:38.376996 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:38.449771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:38.461727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f468fc93-592d-4c10-8670-abbfe51c3213 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1297 microversion: 2.1 time: 0.098972 Sep 29 02:21:38.463087 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 439/865] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:38 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:39.489693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:39.490334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:39.497277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:39.497785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:39.498237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:39.498935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:39.499371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:39.500153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:39.720114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:39.731223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-59f96427-68c5-4a26-984a-c9385b88c023 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.246756 Sep 29 02:21:39.731803 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 427/866] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:39 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:21:40.254778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-c063669a-4671-4f9a-8e9a-c6ff188465eb req-714c505b-0c2b-4355-992d-390d61c533d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba17fd87-1d98-421f-8d5c-fa0a77b51165", "tag": "28d1e650-93d3-4314-83bc-9645d4e3c23f"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:40.267537 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-c063669a-4671-4f9a-8e9a-c6ff188465eb req-714c505b-0c2b-4355-992d-390d61c533d4 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:40.268301 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-c063669a-4671-4f9a-8e9a-c6ff188465eb req-714c505b-0c2b-4355-992d-390d61c533d4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:40.268771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-c063669a-4671-4f9a-8e9a-c6ff188465eb req-714c505b-0c2b-4355-992d-390d61c533d4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:40.280871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-c063669a-4671-4f9a-8e9a-c6ff188465eb req-714c505b-0c2b-4355-992d-390d61c533d4 service nova] Creating event network-changed:28d1e650-93d3-4314-83bc-9645d4e3c23f for instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 on hv-cinder-73306 Sep 29 02:21:40.286345 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-c063669a-4671-4f9a-8e9a-c6ff188465eb req-714c505b-0c2b-4355-992d-390d61c533d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036966 Sep 29 02:21:40.286939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 440/867] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:40.755782 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:40.756431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:40.763537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:40.764067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:40.764526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:40.765220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:40.765669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:40.766117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:40.912041 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:40.927841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bdbf6790-3f7e-4d81-b713-bcd84ab2b177 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.176559 Sep 29 02:21:40.928739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 428/868] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:40 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:41.954450 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:41.955521 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:41.963378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:41.963837 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:41.964364 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:41.965061 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:41.965541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:41.965960 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:42.122771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:42.132267 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-42ac819e-b6f5-4036-b434-697aa5248c07 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.183418 Sep 29 02:21:42.132863 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 441/869] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:41 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:43.155334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:43.155966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:43.163154 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:43.163633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:43.164097 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:43.164785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:43.165233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:43.165650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:43.303197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:43.311163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-03a861a9-0349-4267-967a-b5f88168ebf8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.159760 Sep 29 02:21:43.311733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 429/870] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:43 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:44.338993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:44.339691 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:44.348484 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:44.348974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:44.349406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:44.350135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:44.350586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:44.351008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:44.490760 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:44.498782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4fdfa547-13aa-4411-a765-efc7d0ad49e8 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.164953 Sep 29 02:21:44.499541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 442/871] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:44 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:45.524327 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:45.524904 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:45.531968 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:45.532455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:45.533108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:45.533731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:45.534224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:45.534649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:45.669291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:45.677720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b92e306-928d-4746-a17b-57163f9f9e47 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.157407 Sep 29 02:21:45.678306 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 430/872] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:45 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:46.707551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:46.708520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:46.715523 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:46.716329 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:46.717306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:46.717806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-50b4ae75-84e7-476f-aa37-2ecd7f0c6331 req-e0d82bba-74ff-4c07-9d83-5d00715c6be4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17fd87-1d98-421f-8d5c-fa0a77b51165", "name": "network-vif-plugged", "status": "completed", "tag": "28d1e650-93d3-4314-83bc-9645d4e3c23f"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:46.718290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:46.718637 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:46.719057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:46.728940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50b4ae75-84e7-476f-aa37-2ecd7f0c6331 req-e0d82bba-74ff-4c07-9d83-5d00715c6be4 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:46.729481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50b4ae75-84e7-476f-aa37-2ecd7f0c6331 req-e0d82bba-74ff-4c07-9d83-5d00715c6be4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:46.730181 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-50b4ae75-84e7-476f-aa37-2ecd7f0c6331 req-e0d82bba-74ff-4c07-9d83-5d00715c6be4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:46.741758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-50b4ae75-84e7-476f-aa37-2ecd7f0c6331 req-e0d82bba-74ff-4c07-9d83-5d00715c6be4 service nova] Creating event network-vif-plugged:28d1e650-93d3-4314-83bc-9645d4e3c23f for instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 on hv-cinder-73306 Sep 29 02:21:46.746776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-50b4ae75-84e7-476f-aa37-2ecd7f0c6331 req-e0d82bba-74ff-4c07-9d83-5d00715c6be4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033987 Sep 29 02:21:46.747375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 431/873] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:46.862732 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:46.871094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9b8aade7-7f21-4d0b-8f04-47253714d042 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.168238 Sep 29 02:21:46.871653 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 443/874] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:46 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:47.893040 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:47.898241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:47.898939 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:47.905633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:47.906155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:47.906594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:47.907296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:47.907756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:47.908184 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:48.044382 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:48.052860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-729fd4b2-7324-4857-962a-696f7c0674d3 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.161450 Sep 29 02:21:48.053419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 432/875] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:47 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:49.079182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:49.080154 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:49.083110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:49.083773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:21:49.090683 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:49.091164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:49.091608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:49.092313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:49.092778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:49.093207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:49.235356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:49.243574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3c0cfad5-9c93-4523-bd9f-607676556999 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1362 microversion: 2.1 time: 0.171002 Sep 29 02:21:49.244140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 444/876] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:49 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:50.278796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:50.279658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:50.288832 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:50.289294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:50.289726 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:50.290446 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:50.290906 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:50.291322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:50.431074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:21:50.442302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0594769d-adf7-4690-9304-5c0298770c40 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1547 microversion: 2.1 time: 0.170249 Sep 29 02:21:50.442871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 433/877] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:21:50 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:21:50.476343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:50.476885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:50.483746 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:50.484236 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:50.484678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:50.485379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:50.485844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:50.486304 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:50.565238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f64f521f-5a8e-4ee5-852c-f56fea592f05 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093964 Sep 29 02:21:50.565843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 445/878] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:21:50 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:51.530732 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:21:51.531940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:51.539485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:51.539969 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:51.540370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:51.541346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:51.541770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:51.542216 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:51.567349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-908d3b17-4ac2-4213-9ff1-cf4556fdaa44 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/ips" status: 200 len: 148 microversion: 2.1 time: 0.040742 Sep 29 02:21:51.568595 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 434/879] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:21:51 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:51.763417 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-20fa8efa-944c-4776-975d-1749e7891930 req-404c5fc0-3d5c-40eb-851e-130b6ee07f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba17fd87-1d98-421f-8d5c-fa0a77b51165", "tag": "28d1e650-93d3-4314-83bc-9645d4e3c23f"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:51.773767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-20fa8efa-944c-4776-975d-1749e7891930 req-404c5fc0-3d5c-40eb-851e-130b6ee07f04 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:51.774739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-20fa8efa-944c-4776-975d-1749e7891930 req-404c5fc0-3d5c-40eb-851e-130b6ee07f04 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:51.775377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-20fa8efa-944c-4776-975d-1749e7891930 req-404c5fc0-3d5c-40eb-851e-130b6ee07f04 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:51.787939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-20fa8efa-944c-4776-975d-1749e7891930 req-404c5fc0-3d5c-40eb-851e-130b6ee07f04 service nova] Creating event network-changed:28d1e650-93d3-4314-83bc-9645d4e3c23f for instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 on hv-cinder-73306 Sep 29 02:21:51.793675 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-20fa8efa-944c-4776-975d-1749e7891930 req-404c5fc0-3d5c-40eb-851e-130b6ee07f04 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034492 Sep 29 02:21:51.794656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 446/880] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:21:52.967301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:21:52.969643 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:21:52.976244 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:52.976723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:52.977233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:52.977954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:21:52.978436 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:21:52.978952 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:21:53.262785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79dd814f-df04-48a4-bfea-1e9c1bb5a62c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299426 Sep 29 02:21:53.263412 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 435/881] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:21:52 2022] POST /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:00.851196 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:00.854223 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:00.856188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:00.861623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:00.862163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:00.862585 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:00.863273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:00.863726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:00.864147 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:00.867235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=59 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:00.949335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Invalid volume: volume b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b is already attached to instances: 2dd20e5a-93ae-453e-95fd-de7659e3f700 Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: POST /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments HTTP/1.1 Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 74 Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:22:00.951125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {"volumeAttachment": {"volumeId": "b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b"}} Sep 29 02:22:00.952932 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Invalid volume: volume b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b is already attached to instances: 2dd20e5a-93ae-453e-95fd-de7659e3f700 Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'server_id': '2dd20e5a-93ae-453e-95fd-de7659e3f700', 'body': {'volumeAttachment': {'volumeId': 'b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b'}}} Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b is already attached to instances: 2dd20e5a-93ae-453e-95fd-de7659e3f700 Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:00.953741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b is already attached to instances: 2dd20e5a-93ae-453e-95fd-de7659e3f700 Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:22:00.955054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b is already attached to instances: 2dd20e5a-93ae-453e-95fd-de7659e3f700 Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 400 to user: Invalid volume: volume b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b is already attached to instances: 2dd20e5a-93ae-453e-95fd-de7659e3f700 {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-15e6a89e-a903-43ba-9731-a0f3f22a76e2 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106583 Sep 29 02:22:00.956567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 447/882] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:22:00 2022] POST /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:22:01.032805 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:01.033367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:01.035448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:01.040890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:01.041370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:01.041825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:01.042563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:01.042972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:01.043393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:01.047810 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:01.128575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'services' on Instance uuid 2dd20e5a-93ae-453e-95fd-de7659e3f700 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:22:01.212437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ba22f5f7-9551-4f4c-9d12-8efa5084e40a tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments/b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b" status: 202 len: 0 microversion: 2.1 time: 0.184417 Sep 29 02:22:01.213037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 436/883] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:22:01 2022] DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments/b9e85f7e-b0bb-43e4-9f59-cdd7dfb4b90b => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:22:01.221778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:01.223981 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:01.231730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:01.232230 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:01.232655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:01.233352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:01.233821 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:01.234259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:01.267580 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-50030084-ad2b-478f-947f-301bb03a0873 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049745 Sep 29 02:22:01.268055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 448/884] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:22:01 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:02.281096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:02.283470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:02.290333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:02.290906 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:02.291350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:02.292193 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:02.293229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:02.293798 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:02.325963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d004c34e-c351-4ab6-afa1-595db2bbb4f9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049161 Sep 29 02:22:02.326921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 437/885] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:22:02 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:22:03.340313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:03.342503 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:03.349324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:03.349803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:03.350259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:03.350969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:03.351468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:03.351893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:03.382211 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2794a154-9996-4557-9314-c1f1bd12f0ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046616 Sep 29 02:22:03.382751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 449/886] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:22:03 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 29 02:22:03.464813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:03.465384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:03.472294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:03.473115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:03.473555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:03.474541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:03.475001 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:03.475426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:03.501251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:22:03.588950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f9f3fa55-3009-4958-bb62-1f85888a9a8c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 204 len: 0 microversion: 2.1 time: 0.129462 Sep 29 02:22:03.589575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 438/887] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:22:03 2022] DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:22:03.598243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:03.598808 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:03.604941 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:03.605444 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:03.605858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:03.606599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:03.607046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:03.607460 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:03.744369 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:03.757689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-51a00933-3f0c-44e1-a79d-94eb36bb579c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1681 microversion: 2.1 time: 0.163170 Sep 29 02:22:03.758529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 450/888] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:03 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:04.786066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:04.787497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:04.798495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:04.799387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:04.799953 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:04.801108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:04.801854 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:04.802587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:04.939086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:04.947719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3c0dae69-01a2-4ae8-905c-03d26796954b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1681 microversion: 2.1 time: 0.168537 Sep 29 02:22:04.948148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 439/889] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:04 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:05.981251 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:05.981940 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:05.989939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:05.990546 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:05.991064 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:05.991874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:05.992406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:05.992934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:06.137260 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:06.145577 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d1b0830f-641e-4e85-9428-bb3464f84c20 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1681 microversion: 2.1 time: 0.170452 Sep 29 02:22:06.146172 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 451/890] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:05 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:07.174445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:07.175596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:07.188335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:07.188822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:07.189263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:07.189985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:07.190446 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:07.190896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:07.327277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:07.335663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a48344f-0fc1-4ae6-b90e-a84c7a01d821 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1681 microversion: 2.1 time: 0.168437 Sep 29 02:22:07.336215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 440/891] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:07 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:08.371957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:08.373036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:08.380518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:08.380992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:08.381427 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:08.382168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:08.382633 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:08.383056 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:08.522562 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:08.531589 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f937930e-5736-470c-bcc0-ede776242677 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1681 microversion: 2.1 time: 0.166192 Sep 29 02:22:08.532372 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 452/892] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:08 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:09.557638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:09.558331 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:09.565673 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:09.566116 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:09.566604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:09.567157 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:09.567603 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:09.568021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:09.771838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:09.779791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e872dfe4-d9c7-4fea-a2ca-2a5ee09d34ab tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1681 microversion: 2.1 time: 0.228595 Sep 29 02:22:09.780389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 441/893] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:09 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:10.550814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-72e2b9ba-86da-4039-b3bb-54d8531f9e91 req-3cfad6e4-7cc7-470b-b51b-f08ca0750bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd20e5a-93ae-453e-95fd-de7659e3f700", "name": "network-vif-deleted", "tag": "ba3b2417-d526-4c9c-9ea5-f22aefaa6148"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:10.562726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-72e2b9ba-86da-4039-b3bb-54d8531f9e91 req-3cfad6e4-7cc7-470b-b51b-f08ca0750bbc service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:10.563207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-72e2b9ba-86da-4039-b3bb-54d8531f9e91 req-3cfad6e4-7cc7-470b-b51b-f08ca0750bbc service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:10.563635 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-72e2b9ba-86da-4039-b3bb-54d8531f9e91 req-3cfad6e4-7cc7-470b-b51b-f08ca0750bbc service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:10.575044 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-72e2b9ba-86da-4039-b3bb-54d8531f9e91 req-3cfad6e4-7cc7-470b-b51b-f08ca0750bbc service nova] Creating event network-vif-deleted:ba3b2417-d526-4c9c-9ea5-f22aefaa6148 for instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 on hv-cinder-73306 Sep 29 02:22:10.580671 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-72e2b9ba-86da-4039-b3bb-54d8531f9e91 req-3cfad6e4-7cc7-470b-b51b-f08ca0750bbc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033719 Sep 29 02:22:10.581276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 453/894] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:10.803033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:10.804458 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:10.812096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:10.813776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:10.814323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:10.815114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:10.815759 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:10.816242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:10.860171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:10.860658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:10.861081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:10.861529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'fault' on Instance uuid 2dd20e5a-93ae-453e-95fd-de7659e3f700 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:22:10.907620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:10.915379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af868223-8cd0-4f1c-9151-083c327278a8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 200 len: 1332 microversion: 2.1 time: 0.116032 Sep 29 02:22:10.918191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 442/895] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:10 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:11.946170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:11.947285 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:11.955630 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:11.956115 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:11.956551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:11.957249 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:11.957706 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:11.958162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:11.972750 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 HTTP/1.1 Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:22:11.974439 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:22:11.976076 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '2dd20e5a-93ae-453e-95fd-de7659e3f700'} Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:22:11.976879 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:22:11.978262 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:22:11.979469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:22:11.979469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-541a3642-318b-4313-b8fb-fd161d4cf76c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 404 len: 111 microversion: 2.1 time: 0.037790 Sep 29 02:22:11.980203 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 454/896] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:11 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:22:11.985383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6b0c15d2-9780-4367-b755-20c36b581d22 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '.version_select at 0x7f4051249d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:12.006209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6b0c15d2-9780-4367-b755-20c36b581d22 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854311870" status: 202 len: 0 microversion: 2.1 time: 0.025074 Sep 29 02:22:12.006804 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 443/897] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 29 02:22:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1854311870 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:22:12.638801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-746db676-e94b-490f-aee2-14e55bd13959 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: .version_select at 0x7f404d8df670>, body: {"keypair": {"name": "tempest-keypair-1303224747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuJT76z7av7e7M6WMTt6E0d4/USBKRycmgUbLn1dJMyopmUnk1S3WKr3agZez6LtaCdjGL1t/7ImIhM6nm/6VRPa69Ug5U4SNhljJvwC4gh/q5ABqZUgrK7rOlkJiWR1A=="}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:12.654549 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-746db676-e94b-490f-aee2-14e55bd13959 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:22:12.658638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-746db676-e94b-490f-aee2-14e55bd13959 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'key_pairs'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:22:12.684189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-746db676-e94b-490f-aee2-14e55bd13959 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051806 Sep 29 02:22:12.684771 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 455/898] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:22:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:14.282045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1854191367", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21696cbf-ef5b-4f26-afb0-c5d58c71da44"}], "security_groups": [{"name": "tempest-securitygroup--1921723602"}], "key_name": "tempest-keypair-1303224747", "user_data": "}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:14.395368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] validate_networks() for [('21696cbf-ef5b-4f26-afb0-c5d58c71da44', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:22:14.773670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:22:14.774149 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:22:14.774857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:22:14.775304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:22:14.775864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:22:14.785927 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:14.786541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:14.786942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:14.787830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:14.788320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:14.788730 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:14.805890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:22:14.810378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Getting quotas for user a6111a16f95d4bc58f84d9f60f703d80 and project 9006f0bb109c4c96a387ff5c314f236e. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:22:14.821564 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:22:14.824106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:22:14.873393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9ba8d39d-1c7c-45af-a21a-c72713ed88cf tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597076 Sep 29 02:22:14.874266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 444/899] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:22:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:22:14.886968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-aa6b1138-0aab-4fa0-b7dd-fa39cbb7120d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:14.888238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-aa6b1138-0aab-4fa0-b7dd-fa39cbb7120d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:14.982880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-aa6b1138-0aab-4fa0-b7dd-fa39cbb7120d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:14.989758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-aa6b1138-0aab-4fa0-b7dd-fa39cbb7120d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1242 microversion: 2.1 time: 0.107683 Sep 29 02:22:14.990348 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 456/900] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:14 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:22:16.016955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:16.018684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:16.026937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:16.027811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:16.027811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:16.028476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:16.028921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:16.029402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:16.097828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:16.105789 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c719deb-4bef-4eef-b2e1-12b1308506c4 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1294 microversion: 2.1 time: 0.095510 Sep 29 02:22:16.106486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 445/901] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:16 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:17.131978 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:17.132594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:17.139001 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:17.139487 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:17.140712 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:17.141448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:17.141908 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:17.142368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:17.280399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:17.298591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-914d3377-8cf4-4c7f-b99c-31de4dcb1743 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.170614 Sep 29 02:22:17.301489 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 457/902] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:17 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:17.697959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e2010fb7-42ad-407e-9346-396e1c909076 req-d4ad2b66-f0be-4607-b879-a41adc13e729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e", "tag": "5fd5d443-9b1d-486c-b4c4-501c962f12ee"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:17.709936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e2010fb7-42ad-407e-9346-396e1c909076 req-d4ad2b66-f0be-4607-b879-a41adc13e729 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:17.710526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e2010fb7-42ad-407e-9346-396e1c909076 req-d4ad2b66-f0be-4607-b879-a41adc13e729 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:17.711064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e2010fb7-42ad-407e-9346-396e1c909076 req-d4ad2b66-f0be-4607-b879-a41adc13e729 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:17.724008 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e2010fb7-42ad-407e-9346-396e1c909076 req-d4ad2b66-f0be-4607-b879-a41adc13e729 service nova] Creating event network-changed:5fd5d443-9b1d-486c-b4c4-501c962f12ee for instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e on hv-cinder-73306 Sep 29 02:22:17.728864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e2010fb7-42ad-407e-9346-396e1c909076 req-d4ad2b66-f0be-4607-b879-a41adc13e729 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034719 Sep 29 02:22:17.729464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 446/903] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:18.327651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:18.329165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:18.339694 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:18.340491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:18.341201 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:18.342434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:18.343534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:18.343858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:18.476498 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:18.487368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-83aa1eef-1c21-49ac-ac1b-c4341ffa04b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.166470 Sep 29 02:22:18.487915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 458/904] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:18 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:19.516390 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:19.517038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:19.523792 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:19.524281 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:19.524713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:19.525407 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:19.525861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:19.526320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:19.656196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:19.663993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1367aca-d23c-4e11-813b-17723fa2cd8d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.155066 Sep 29 02:22:19.664562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 447/905] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:19 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:20.689141 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:20.689723 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:20.696897 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:20.697442 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:20.697917 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:20.698655 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:20.699116 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:20.699538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:20.834780 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:20.844414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e7229250-06cd-4074-a19a-13f73aa1603e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.160069 Sep 29 02:22:20.859101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 459/906] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:20 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:21.873052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:21.874053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:21.881594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:21.882112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:21.882540 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:21.883223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:21.883667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:21.884089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:22.026626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:22.036652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a611df36-c339-4935-a490-b356c9d1f9b8 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.169938 Sep 29 02:22:22.037235 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 448/907] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:21 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:23.021767 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-1ade7856-249d-4b0b-9de7-4a0bccea5ffd req-32bd8738-5b99-4d33-92af-d788bfd4eb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e", "name": "network-vif-plugged", "status": "completed", "tag": "5fd5d443-9b1d-486c-b4c4-501c962f12ee"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:23.035955 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-1ade7856-249d-4b0b-9de7-4a0bccea5ffd req-32bd8738-5b99-4d33-92af-d788bfd4eb71 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:23.036631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-1ade7856-249d-4b0b-9de7-4a0bccea5ffd req-32bd8738-5b99-4d33-92af-d788bfd4eb71 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:23.037747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-1ade7856-249d-4b0b-9de7-4a0bccea5ffd req-32bd8738-5b99-4d33-92af-d788bfd4eb71 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:23.051588 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-1ade7856-249d-4b0b-9de7-4a0bccea5ffd req-32bd8738-5b99-4d33-92af-d788bfd4eb71 service nova] Creating event network-vif-plugged:5fd5d443-9b1d-486c-b4c4-501c962f12ee for instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e on hv-cinder-73306 Sep 29 02:22:23.057025 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-1ade7856-249d-4b0b-9de7-4a0bccea5ffd req-32bd8738-5b99-4d33-92af-d788bfd4eb71 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039177 Sep 29 02:22:23.057861 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 460/908] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:23.059412 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:23.060059 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:23.067246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:23.067736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:23.068170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:23.068872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:23.069323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:23.069725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:23.219723 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:23.228077 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f46653b5-2924-40f5-b0e0-4ce3aee0a6f0 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.172813 Sep 29 02:22:23.228901 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 449/909] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:23 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:22:24.257758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:24.258945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:24.269752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:24.270742 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:24.271465 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:24.272596 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:24.273345 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:24.274083 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:24.413551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:24.421572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9b1f9cf0-b37c-4803-9b87-59b05e0fe8b1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.172337 Sep 29 02:22:24.422229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 461/910] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:24 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:24.737031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:24.737613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:24.744281 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:24.744770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:24.745200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:24.745897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:24.746379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:24.746800 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:24.771335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0066341e-b025-4b9f-b5c8-bcdd01862492 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/ips" status: 200 len: 150 microversion: 2.20 time: 0.039555 Sep 29 02:22:24.771899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 450/911] 10.222.0.61 () {60 vars in 1289 bytes} [Thu Sep 29 02:22:24 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:22:25.455551 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:25.456180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:25.458575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:25.466051 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:25.466679 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:25.467225 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:25.468077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:25.468639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:25.469467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:25.608333 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:25.620627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1e5c69a5-5189-46fd-bba1-d42fa4208cae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.171623 Sep 29 02:22:25.621558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 462/912] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:25 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:26.647127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:26.647715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:26.649934 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:26.650719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:26.659100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:26.659583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:26.660014 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:26.660762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:26.661205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:26.661617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:26.820151 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:26.830109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-27472e1b-07c4-41f7-af15-6aed9c33e932 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.189182 Sep 29 02:22:26.830699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 451/913] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:26 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:27.857253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:27.858258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:27.869730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:27.870587 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:27.871302 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:27.872441 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:27.873204 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:27.873895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:28.009619 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:28.022430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c2d880bf-a2e9-4b37-a61b-da2a209e57ae tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.171522 Sep 29 02:22:28.023235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 463/914] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:27 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:29.053557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:29.054260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:29.062806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:29.063361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:29.063862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:29.064655 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:29.065520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:29.065989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:29.202628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:29.204838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:29.211943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-94322208-c760-4c8a-8184-5a3ca25a4a39 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1368 microversion: 2.1 time: 0.165025 Sep 29 02:22:29.212899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 452/915] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:29 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:29.780647 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:29.781277 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:29.788050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:29.788532 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:29.788960 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:29.789658 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:29.790137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:29.790540 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:29.814420 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lazy-loading 'flavor' on Instance uuid 56f58670-0230-4d73-8f7f-c3de3e04856d {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:22:30.022401 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ed065210-e71f-4c99-a200-735db15c5d62 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/action" status: 202 len: 0 microversion: 2.20 time: 0.245515 Sep 29 02:22:30.023035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 464/916] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 29 02:22:29 2022] POST /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:22:30.033802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:30.034430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:30.041432 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:30.042075 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:30.042554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:30.043290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:30.043887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:30.044397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:30.180977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:30.189255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:30.190709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:30.191880 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-11e95911-10f0-4730-bcca-079647db4f04 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.163232 Sep 29 02:22:30.192413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 453/917] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:30 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:30.240926 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:30.241985 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:30.252053 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:30.252801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:30.253800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:30.254857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:30.255543 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:30.256391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:30.400868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:30.404815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:30.412678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1d0d5a42-8600-4d12-bec0-643bfff33bc3 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1556 microversion: 2.1 time: 0.178883 Sep 29 02:22:30.413488 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 465/918] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:22:30 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1556 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:22:30.445141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:30.445691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:30.453651 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:30.454232 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:30.454691 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:30.455582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:30.456152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:30.456779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:30.537234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-21454c42-d496-4273-abd7-c6473946b4ce tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098077 Sep 29 02:22:30.538215 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 454/919] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 29 02:22:30 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:22:31.218665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:31.219253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:31.222167 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:31.228636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:31.229245 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:31.229704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:31.230536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:31.231017 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:31.231376 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:31.436204 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:31.445500 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:31.446996 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:31.448170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1de8ac29-5f2a-4316-80cc-f6f60370a68a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.233795 Sep 29 02:22:31.448951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 466/920] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:31 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:31.585098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-e85af21c-c558-4ff6-a01b-2911c19f6f91 req-c1dfb00f-c08e-4a23-a7b8-31a4101373ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e", "tag": "5fd5d443-9b1d-486c-b4c4-501c962f12ee"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:31.589927 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:22:31.595635 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e85af21c-c558-4ff6-a01b-2911c19f6f91 req-c1dfb00f-c08e-4a23-a7b8-31a4101373ad service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:31.596112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e85af21c-c558-4ff6-a01b-2911c19f6f91 req-c1dfb00f-c08e-4a23-a7b8-31a4101373ad service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:31.596535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-e85af21c-c558-4ff6-a01b-2911c19f6f91 req-c1dfb00f-c08e-4a23-a7b8-31a4101373ad service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:31.609423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-e85af21c-c558-4ff6-a01b-2911c19f6f91 req-c1dfb00f-c08e-4a23-a7b8-31a4101373ad service nova] Creating event network-changed:5fd5d443-9b1d-486c-b4c4-501c962f12ee for instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e on hv-cinder-73306 Sep 29 02:22:31.614847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-e85af21c-c558-4ff6-a01b-2911c19f6f91 req-c1dfb00f-c08e-4a23-a7b8-31a4101373ad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034394 Sep 29 02:22:31.615604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 455/921] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:32.473913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:32.474591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:32.481927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:32.482509 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:32.483157 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:32.483863 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:32.484312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:32.484732 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:32.621300 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:32.630725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:32.632197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:32.633538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-93c19ec5-d112-4572-b249-dd5fa30b3364 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.163697 Sep 29 02:22:32.634123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 467/922] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:32 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:33.667985 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:33.668594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:33.675696 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:33.676228 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:33.676710 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:33.677448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:33.677948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:33.679191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:33.820526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:33.829183 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:33.830858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:33.832010 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f400db6d-5fb0-4417-8a37-f54cfd9c3622 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.170474 Sep 29 02:22:33.832532 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 456/923] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:33 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:34.858507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:34.859173 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:34.866276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:34.866766 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:34.867197 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:34.867899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:34.868357 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:34.868876 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:35.018123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:35.027575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:35.029044 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:35.030257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-17ef3ec8-ccf4-4fdb-9150-a7e71b3f403b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.175720 Sep 29 02:22:35.030824 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 468/924] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:34 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:22:36.059656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:36.060263 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:36.067117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:36.067627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:36.068027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:36.068741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:36.069182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:36.069600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:36.226254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:36.236979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:36.238464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:36.239701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6f3298b-21f9-4cdd-a8c1-e889e8bf332f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.186641 Sep 29 02:22:36.240225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 457/925] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:36 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:37.273138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:37.273780 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:37.280529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:37.281018 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:37.281455 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:37.282258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:37.282718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:37.283145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:37.427240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:37.438936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:37.440396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:37.441636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9a31b5b8-7bfa-49c7-aa51-1cfda5316ff4 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.172513 Sep 29 02:22:37.442523 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 469/926] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:37 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:38.475544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:38.476197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:38.483163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:38.483642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:38.484067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:38.484762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:38.485207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:38.485623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:38.784614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:38.792931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:38.794158 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:38.795320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9cf5dff4-67f0-40ad-822a-b5317c13cb1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.323865 Sep 29 02:22:38.795849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 458/927] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:38 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:39.821699 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:39.822337 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:39.830062 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:39.830247 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:39.830684 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:39.831402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:39.831866 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:39.832297 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:39.970471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:39.979976 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:39.981476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:39.982726 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-720ba858-9542-4549-9186-ae1f32688605 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.165296 Sep 29 02:22:39.983289 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 470/928] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:39 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:41.009037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:41.009671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:41.016678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:41.017156 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:41.017586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:41.018312 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:41.018758 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:41.019174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:41.165072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:41.173378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:41.174827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:41.175971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a0de370-5abc-4c35-9c44-693a162fd0f6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.171108 Sep 29 02:22:41.176536 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 459/929] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:41 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:42.201335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:42.201951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:42.208776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:42.209259 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:42.210096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:42.210575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:42.211021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:42.211452 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:42.355072 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:42.363459 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:42.364889 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:42.366165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d316e77c-f3dc-4e48-8d99-ea4a612822ae tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1742 microversion: 2.20 time: 0.168904 Sep 29 02:22:42.366727 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 471/930] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:42 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1742 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:43.397027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:43.398415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:43.404654 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:43.405135 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:43.405562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:43.406280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:43.406733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:43.407353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:43.542284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:43.552912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:43.554544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:43.555731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-af4de795-bc28-41f5-989a-8d4d0e587b28 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1742 microversion: 2.20 time: 0.165471 Sep 29 02:22:43.556283 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 460/931] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:43 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:44.581324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:44.582038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:44.588914 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:44.589400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:44.589827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:44.590544 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:44.590992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:44.591425 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:44.730971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:44.739377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:44.740810 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:44.742124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-245a5b4a-e0ff-4a90-bff6-ae9b21403612 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1742 microversion: 2.20 time: 0.164847 Sep 29 02:22:44.742672 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 472/932] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:44 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1742 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:45.774676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:45.775623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:45.786666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:45.787472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:45.788201 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:45.789452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:45.790031 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:45.790480 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:45.928755 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:45.937023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:45.938478 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:45.939634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2392986c-077d-46e8-9c92-07afa163e351 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1742 microversion: 2.20 time: 0.171685 Sep 29 02:22:45.940183 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 461/933] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:45 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:46.966368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:46.966931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:46.973751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:46.974335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:46.974755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:46.975442 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:46.975893 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:46.976319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:47.104243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8a2d5fb6-e4dd-453d-ae05-993c189e82f2 req-bd7746e6-4fd3-486c-a8b5-3b7003545a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "name": "network-vif-plugged", "status": "completed", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:22:47.115254 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8a2d5fb6-e4dd-453d-ae05-993c189e82f2 req-bd7746e6-4fd3-486c-a8b5-3b7003545a01 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:47.115827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8a2d5fb6-e4dd-453d-ae05-993c189e82f2 req-bd7746e6-4fd3-486c-a8b5-3b7003545a01 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:47.116352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8a2d5fb6-e4dd-453d-ae05-993c189e82f2 req-bd7746e6-4fd3-486c-a8b5-3b7003545a01 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:47.128921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8a2d5fb6-e4dd-453d-ae05-993c189e82f2 req-bd7746e6-4fd3-486c-a8b5-3b7003545a01 service nova] Creating event network-vif-plugged:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:22:47.134400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8a2d5fb6-e4dd-453d-ae05-993c189e82f2 req-bd7746e6-4fd3-486c-a8b5-3b7003545a01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034379 Sep 29 02:22:47.134989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 462/934] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:22:47.278603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:47.287079 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:47.288510 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:47.290407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-81d1d11c-9631-4a07-ac5f-e8157c8c859b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1742 microversion: 2.20 time: 0.327698 Sep 29 02:22:47.294067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 473/935] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:46 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1742 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:48.318101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:48.318887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:48.325809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:48.326551 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:48.326981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:48.327847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:48.328539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:48.328958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:48.528158 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:48.536797 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:48.538235 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:48.539391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7767bf15-c0a4-4012-9dfd-0b74c3aa5700 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.227654 Sep 29 02:22:48.540060 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 463/936] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:48 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:49.570567 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:49.572430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:49.582744 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:49.583617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:49.584154 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:49.584968 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:49.585423 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:49.585851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:49.722053 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:49.731063 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:49.732491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:49.733846 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-10e8be3b-1eaa-4813-966a-47e57e1507d6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.167830 Sep 29 02:22:49.734629 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 474/937] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:49 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:50.765369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:50.766908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:50.778311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:50.779153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:50.779830 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:50.780746 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:50.781383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:50.781981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:50.923106 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:50.932003 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:50.933384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:50.934620 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6de88e9e-36cf-45e7-a23b-af5084b90edf tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.179636 Sep 29 02:22:50.935177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 464/938] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:50 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:51.962399 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:51.964248 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:51.973150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:51.973853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:51.974550 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:51.975923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:51.976580 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:51.976993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:52.118573 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:52.129574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:52.131352 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:52.132517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-beaedf7e-fd9a-46ac-9bce-8b3b6f02714b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.175378 Sep 29 02:22:52.133729 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 475/939] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:51 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:53.161489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:53.163662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:53.171794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:53.180882 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:53.181378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:53.182314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:53.183389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:53.183873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:53.339374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:53.347814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:53.349368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:53.350562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d2afad9b-9ecf-4523-bf6a-c06a3cd40077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.195807 Sep 29 02:22:53.351117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 465/940] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:53 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:54.527783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:54.528404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:54.534745 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:54.535239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:54.535678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:54.536381 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:54.536838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:54.537261 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:54.685397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:54.693807 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:54.695289 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:54.696474 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5c8274d0-49a9-4be1-a418-5a82363c4e90 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.324508 Sep 29 02:22:54.714184 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 476/941] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:54 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:55.723177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:55.723845 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:55.731063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:55.731542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:55.732002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:55.732890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:55.733365 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:55.733817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:55.869144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:55.877686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:55.879161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:55.880714 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d0f5ce59-4137-4c36-a911-5c64db938a88 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.162312 Sep 29 02:22:55.881875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 466/942] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:55 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:56.911464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:56.912061 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:56.918785 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:56.919270 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:56.919704 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:56.920404 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:56.920854 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:56.921274 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:57.063613 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:57.072334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:57.075587 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:57.077055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5f8fcb4f-5f0e-4823-9af8-5c4e6f358b0d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.169590 Sep 29 02:22:57.078058 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 477/943] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:56 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:58.104708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:58.105315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:58.115974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:58.116658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:58.117384 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:58.118811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:58.119281 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:58.119846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:58.289338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:58.299393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:58.301020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:58.302415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fd6213f6-5bdb-4609-87af-f91fd76762d5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.201735 Sep 29 02:22:58.318445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 467/944] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:58 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:22:59.329937 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:22:59.331298 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:22:59.338120 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:59.338773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:59.339471 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:59.340511 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:22:59.341212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:22:59.341724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:22:59.481068 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:59.490541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:59.492023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:22:59.493212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-37f280a0-d51e-425a-aa53-bdf3076d6e3a tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.167588 Sep 29 02:22:59.493810 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 478/945] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:22:59 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:00.523272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:00.524099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:00.542974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:00.545474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:00.545474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:00.545474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:00.545474 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:00.545827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:00.549534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=82 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:00.710128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:00.719421 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:00.720835 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:00.723069 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c22d12ab-89aa-4148-860c-958c713695df tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.207212 Sep 29 02:23:00.723814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 468/946] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:00 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:01.748271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:01.748849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:01.751356 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=26 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:01.757315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:01.757799 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:01.758275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:01.758972 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:01.759430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:01.759856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:01.762689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=80 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:01.897831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:01.906414 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:01.907873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:01.909062 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-bbe4d364-9294-4ed7-911e-1821b38f615f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1737 microversion: 2.20 time: 0.164853 Sep 29 02:23:01.909635 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 479/947] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:01 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:02.944976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:02.945605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:02.952449 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:02.952916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:02.953452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:02.954208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:02.954662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:02.955078 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:03.158761 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:03.167801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:03.169238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:03.170455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bed4c712-ab02-49b0-afa8-2ee7a84bf450 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1719 microversion: 2.20 time: 0.229491 Sep 29 02:23:03.170992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 469/948] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:02 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:04.198506 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:04.199067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:04.206031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:04.206541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:04.206975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:04.207682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:04.208131 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:04.208536 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:04.342690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:04.351074 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:04.352516 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:04.353691 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-542bc517-d2dc-43a9-82db-b33ad1cc4bc6 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1719 microversion: 2.20 time: 0.159202 Sep 29 02:23:04.354275 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 480/949] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:04 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:05.207120 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5111597a-2561-49e3-a804-36301de3cb1f req-3d1f1b4f-dfea-4cee-8571-831bf303aad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "name": "network-vif-unplugged", "status": "completed", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:23:05.212451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=30 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:05.218124 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5111597a-2561-49e3-a804-36301de3cb1f req-3d1f1b4f-dfea-4cee-8571-831bf303aad9 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:05.218643 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5111597a-2561-49e3-a804-36301de3cb1f req-3d1f1b4f-dfea-4cee-8571-831bf303aad9 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:05.219066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5111597a-2561-49e3-a804-36301de3cb1f req-3d1f1b4f-dfea-4cee-8571-831bf303aad9 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:05.231572 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5111597a-2561-49e3-a804-36301de3cb1f req-3d1f1b4f-dfea-4cee-8571-831bf303aad9 service nova] Creating event network-vif-unplugged:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:23:05.236829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5111597a-2561-49e3-a804-36301de3cb1f req-3d1f1b4f-dfea-4cee-8571-831bf303aad9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033796 Sep 29 02:23:05.237388 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 470/950] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:05.380057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:05.380640 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:05.388035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:05.388524 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:05.388961 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:05.389718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:05.390221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:05.390646 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:05.523705 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:05.532928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:05.534396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:05.535580 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-9e439818-2f78-405b-a509-d237bfed4dd5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1722 microversion: 2.20 time: 0.159676 Sep 29 02:23:05.536146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 481/951] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:05 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:05.560919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eb82088-ae18-4716-ad23-d28f5cef7afc"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:23:05.563726 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:05.570698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:05.571233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:05.571664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:05.572358 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:05.572807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:05.573224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:05.888870 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9d6e2d61-8401-4167-9e30-4242957329a8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332313 Sep 29 02:23:05.889408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 471/952] 10.222.0.61 () {62 vars in 1364 bytes} [Thu Sep 29 02:23:05 2022] POST /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 29 02:23:06.021156 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:06.021650 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:06.027856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:06.028335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:06.028765 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:06.029467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:06.029912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:06.030363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:06.290988 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4c57237c-13ed-435b-a7bd-4abbde16a679 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-volume_attachments/0eb82088-ae18-4716-ad23-d28f5cef7afc" status: 202 len: 0 microversion: 2.20 time: 0.273796 Sep 29 02:23:06.291586 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 482/953] 10.222.0.61 () {60 vars in 1457 bytes} [Thu Sep 29 02:23:06 2022] DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-volume_attachments/0eb82088-ae18-4716-ad23-d28f5cef7afc => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:23:06.353763 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:23:06.354362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:06.362176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:06.362666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:06.363000 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:06.363695 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:06.364153 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:06.364573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:06.395774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120698) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 29 02:23:06.477662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-65868d7d-2369-4fda-8b4b-25e78a6bc518 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "POST /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/action" status: 202 len: 0 microversion: 2.20 time: 0.128026 Sep 29 02:23:06.478448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 472/954] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 29 02:23:06 2022] POST /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:23:06.487534 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:06.488110 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:06.494366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:06.494843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:06.495276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:06.495953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:06.496422 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:06.496838 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:06.632885 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:06.641468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:06.642931 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:06.644177 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-18d2008c-e9f5-4b40-beaf-f77dc68e6aab tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1670 microversion: 2.20 time: 0.160829 Sep 29 02:23:06.644721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 483/955] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:06 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 29 02:23:07.669718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:07.670435 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:07.678185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:07.678676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:07.679110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:07.679809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:07.680273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:07.680889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:07.820251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:07.828495 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:07.829899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:07.831099 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9fba6918-815e-4b5c-9a58-41157fe1871d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1670 microversion: 2.20 time: 0.165928 Sep 29 02:23:07.831657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 473/956] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:07 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:08.857612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:08.858365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:08.867052 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:08.867527 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:08.867964 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:08.868676 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:08.869319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:08.869752 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:09.001629 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:09.010826 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:09.012517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:09.013724 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8c13188e-6317-48f6-b37e-fc76b53e9c7b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.160875 Sep 29 02:23:09.014302 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 484/957] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:08 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:10.040240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:10.040943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:10.047539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:10.048026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:10.048458 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:10.049269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:10.050022 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:10.050526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:10.193933 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:10.202752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:10.204182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:10.205348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b652629a-dc23-44c4-9c9e-8b04abc65c1f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.169967 Sep 29 02:23:10.206303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 474/958] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:10 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:11.230889 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:11.231481 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:11.238283 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:11.238867 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:11.239334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:11.240035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:11.240496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:11.240922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:11.381128 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:11.390367 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:11.392042 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:11.393238 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-39a06ab8-5e0b-415d-a8da-8bf735f64382 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.166392 Sep 29 02:23:11.393801 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 485/959] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:11 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:12.418036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:12.418698 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:12.426766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:12.427233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:12.427676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:12.428411 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:12.428867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:12.429291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:12.568826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:12.577268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:12.578776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:12.579967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f3935e1f-3aff-455c-832a-117b0b31cd2b tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.166005 Sep 29 02:23:12.584207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 475/960] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:12 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:13.606135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:13.606880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:13.615371 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:13.615962 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:13.616478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:13.617363 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:13.617827 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:13.618473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:13.758296 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:13.769400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:13.770927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:13.772123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-cc67032b-a2f0-4ca0-9460-26baafddda48 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.170946 Sep 29 02:23:13.772933 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 486/961] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:13 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:14.796998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:14.797617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:14.805118 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:14.805533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:14.805967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:14.806720 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:14.807173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:14.807598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:14.947675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:14.956801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:14.958563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:14.959862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f8461bfb-ea46-4089-ba04-2a48987f9dd2 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.166863 Sep 29 02:23:14.960401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 476/962] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:14 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:15.985253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:15.986575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:15.994140 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:15.994828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:15.995406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:15.996446 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:15.997122 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:15.997660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:16.136251 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:16.144782 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:16.146765 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:16.148093 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-290eca62-22c1-41e9-909f-9fbdc199f077 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.167046 Sep 29 02:23:16.148754 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 487/963] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:15 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:17.174980 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:17.175794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:17.182875 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:17.183364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:17.183793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:17.184522 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:17.184971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:17.185361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:17.323366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:17.332671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:17.334399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:17.335605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0936621-2afb-422a-809c-c47c9125714c tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.164778 Sep 29 02:23:17.336370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 477/964] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:17 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:18.361676 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:18.362430 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:18.369813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:18.370330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:18.370773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:18.371514 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:18.382715 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:18.383194 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:18.524212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:18.532781 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:18.534264 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:18.541409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d8d30a3a-a7d6-4ace-8bc5-dea97cc4b5c5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.184326 Sep 29 02:23:18.541975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 488/965] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:18 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:19.571339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:19.571883 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:19.578963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:19.579442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:19.579872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:19.580556 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:19.581004 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:19.581417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:19.719498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:19.730525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:19.731960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:19.733122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f9eb466-5563-4cf8-a89a-6f19c3246eeb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.166142 Sep 29 02:23:19.733662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 478/966] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:19 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:20.761347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:20.762150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:20.771235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:20.771886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:20.772469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:20.773408 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:20.773847 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:20.774323 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:20.919488 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:20.927998 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:20.929642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:20.930822 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5c951583-86cc-428f-98b6-299786f91711 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.175177 Sep 29 02:23:20.931374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 489/967] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:20 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:21.960342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:21.961267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:21.973335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:21.974057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:21.974849 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:21.975960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:21.976718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:21.977424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:22.123020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:22.132247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:22.133705 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:22.135197 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d4ccf865-5e44-4a99-91e0-d66a1bece255 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.181381 Sep 29 02:23:22.135770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 479/968] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:21 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:23.164665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:23.165493 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:23.175975 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:23.176703 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:23.177357 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:23.178447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:23.179113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:23.179813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:23.324351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:23.333462 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:23.334979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:23.336169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ed7d1777-f482-4dde-836e-4489de8d48db tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.177925 Sep 29 02:23:23.336747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 490/969] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:23 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:24.363098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:24.363707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:24.370724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:24.371200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:24.371632 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:24.372314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:24.372756 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:24.373175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:24.511980 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:24.520908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:24.522362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:24.523514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-71e485b8-e941-406d-b1e3-80e7ee15e75f tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.164423 Sep 29 02:23:24.524072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 480/970] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:24 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:25.550778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:25.551388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:25.558659 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:25.559139 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:25.559569 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:25.560258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:25.560708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:25.561124 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:25.699575 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:25.708112 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:25.709555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:25.710848 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e2683158-9bc3-4886-ac35-a3ac6d959926 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.164205 Sep 29 02:23:25.711390 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 491/971] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:25 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:26.740616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:26.741613 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:26.750348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:26.750837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:26.751276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:26.751977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:26.752508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:26.752943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:26.905546 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:26.909079 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:26.919753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:26.921989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:26.923742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-304b3bac-0589-4754-97bc-e39d072e049d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.189792 Sep 29 02:23:26.924429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 481/972] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:26 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:27.574808 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-70eb26ef-6750-43bc-8485-855bdeca15ec req-189426f3-8784-4a0d-b7af-9b43ee0657f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "name": "network-vif-plugged", "status": "completed", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:23:27.587235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-70eb26ef-6750-43bc-8485-855bdeca15ec req-189426f3-8784-4a0d-b7af-9b43ee0657f6 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:27.588026 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-70eb26ef-6750-43bc-8485-855bdeca15ec req-189426f3-8784-4a0d-b7af-9b43ee0657f6 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:27.588461 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-70eb26ef-6750-43bc-8485-855bdeca15ec req-189426f3-8784-4a0d-b7af-9b43ee0657f6 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:27.600831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-70eb26ef-6750-43bc-8485-855bdeca15ec req-189426f3-8784-4a0d-b7af-9b43ee0657f6 service nova] Creating event network-vif-plugged:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:23:27.606830 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-70eb26ef-6750-43bc-8485-855bdeca15ec req-189426f3-8784-4a0d-b7af-9b43ee0657f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035521 Sep 29 02:23:27.607463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 492/973] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:27.951451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:27.952301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:27.961095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:27.961533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:27.962175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:27.962902 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:27.963357 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:27.965192 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:28.107958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:28.119231 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:28.120873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:28.122036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f802897e-c272-462c-9488-a0327ac0e3ca tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.175897 Sep 29 02:23:28.122637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 482/974] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:27 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:29.153732 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:29.154415 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:29.161210 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:29.161692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:29.162170 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:29.162856 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:29.163320 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:29.163730 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:29.302621 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:29.307930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:29.315703 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:29.317890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:29.320086 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-322b3dcc-3e5f-4031-9335-a1b1142255eb tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1728 microversion: 2.20 time: 0.174473 Sep 29 02:23:29.320631 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 493/975] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:29 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:30.348619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:30.349172 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:30.356021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:30.356504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:30.356930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:30.357629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:30.358113 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:30.358537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:30.501856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:30.510575 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:30.512009 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:30.513344 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8498fb65-0ef7-4a67-86e6-f56d0662f63d tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1715 microversion: 2.20 time: 0.168827 Sep 29 02:23:30.513940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 483/976] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:23:30 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:23:34.446137 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:34.446660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:34.448472 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=30 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:34.454135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:34.454616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:34.455049 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:34.455736 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:34.456186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:34.456608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:34.480467 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fe07b3d7-89d4-435c-a8d4-2999868d9bfa tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/ips" status: 200 len: 145 microversion: 2.1 time: 0.187292 Sep 29 02:23:34.481016 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 494/977] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:23:34 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/ips => generated 145 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:35.870778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9e95159-1ac2-4d1e-9495-192503103872"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:23:35.873296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:35.875593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:23:35.881356 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:35.881842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:35.882310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:35.883368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:35.883827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:35.884256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:36.193559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-678f1c4f-7efa-48a5-849f-3c17818bd099 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326495 Sep 29 02:23:36.194324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 484/978] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:23:35 2022] POST /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:43.794643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:43.797094 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:43.804957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:43.805447 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:43.805874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:43.806598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:43.807051 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:43.807469 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:43.838308 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-50ea63eb-3702-434f-a942-0b9f3b3bd66b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047737 Sep 29 02:23:43.838873 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 495/979] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:23:43 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:43.851206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:43.851839 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:43.858702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:43.859184 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:43.859621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:43.860309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:43.860747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:43.861167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:43.897671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-42725d87-cded-4d68-9afc-624b677b2400 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/c9e95159-1ac2-4d1e-9495-192503103872" status: 200 len: 194 microversion: 2.1 time: 0.051404 Sep 29 02:23:43.898278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 485/980] 10.222.0.61 () {58 vars in 1413 bytes} [Thu Sep 29 02:23:43 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/c9e95159-1ac2-4d1e-9495-192503103872 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:45.272041 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25b6c99e-0032-48dc-951c-9c528b203fc3"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:23:45.274508 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:45.281127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:45.281611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:45.282050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:45.282748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:45.283208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:45.283633 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:45.581832 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d73f5a7e-08e9-488c-8caf-2f8be554812a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "POST /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313778 Sep 29 02:23:45.582833 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 496/981] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:23:45 2022] POST /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:53.209850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:53.212345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:53.219712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:53.220188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:53.220612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:53.221293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:53.221750 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:53.222183 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:53.252481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-182c1713-2a8a-4b74-b218-559cfc17b0cb tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046650 Sep 29 02:23:53.253027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 486/982] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:23:53 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:53.401711 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:53.402315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:53.409295 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:53.409776 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:53.410258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:53.410945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:53.411393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:53.411813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:53.441377 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0f111e3e-5ad5-40a6-877e-fdeaaa1e349b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/c9e95159-1ac2-4d1e-9495-192503103872" status: 200 len: 194 microversion: 2.1 time: 0.044695 Sep 29 02:23:53.441952 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 497/983] 10.222.0.61 () {58 vars in 1413 bytes} [Thu Sep 29 02:23:53 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/c9e95159-1ac2-4d1e-9495-192503103872 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:53.452996 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:53.453487 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:53.459576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:53.460029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:53.460457 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:53.461135 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:53.461584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:53.462027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:53.552389 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lazy-loading 'services' on Instance uuid ba17fd87-1d98-421f-8d5c-fa0a77b51165 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:23:53.630850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d1a61896-d8c1-45ab-b5ca-873e19068e0d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/c9e95159-1ac2-4d1e-9495-192503103872" status: 202 len: 0 microversion: 2.1 time: 0.181740 Sep 29 02:23:53.631809 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 487/984] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:23:53 2022] DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/c9e95159-1ac2-4d1e-9495-192503103872 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:23:55.827902 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:55.828434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:55.835431 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:55.835956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:55.836396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:55.837097 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:55.837555 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:55.837984 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:55.868288 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-3168c112-7465-425c-99fc-afa9f8545305 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/25b6c99e-0032-48dc-951c-9c528b203fc3" status: 200 len: 194 microversion: 2.1 time: 0.044395 Sep 29 02:23:55.868868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 498/985] 10.222.0.61 () {58 vars in 1413 bytes} [Thu Sep 29 02:23:55 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/25b6c99e-0032-48dc-951c-9c528b203fc3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:23:55.883858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:55.884814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:55.891094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:55.891584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:55.892013 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:55.892709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:55.893164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:55.893583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:55.987554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lazy-loading 'services' on Instance uuid ba17fd87-1d98-421f-8d5c-fa0a77b51165 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:23:56.067425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-84a70bef-cbae-45a4-9082-4ab802d87902 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/25b6c99e-0032-48dc-951c-9c528b203fc3" status: 202 len: 0 microversion: 2.1 time: 0.190708 Sep 29 02:23:56.068016 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 488/986] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:23:55 2022] DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments/25b6c99e-0032-48dc-951c-9c528b203fc3 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:23:57.257073 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:57.259803 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:57.266422 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.266895 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.267328 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.268047 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.268477 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.268922 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.301029 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-13a6eff3-4f58-4a24-82c0-55a72a89d45c tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047941 Sep 29 02:23:57.301607 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 499/987] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:23:57 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:23:57.431832 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:57.434961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:57.442701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.443187 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.443627 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.444324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.444781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.445267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.478249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d08abb93-c196-4059-a5df-c866b7fa24d2 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054045 Sep 29 02:23:57.478714 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 489/988] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:23:57 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:23:57.542748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:57.543252 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:57.549392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.549883 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.550334 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.551054 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.551518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.551945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.578322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:23:57.664380 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-62535f57-5287-469e-a7e2-8022d4011e6d tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 204 len: 0 microversion: 2.1 time: 0.125018 Sep 29 02:23:57.664714 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 500/989] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:23:57 2022] DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:23:57.673652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:57.674335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:57.680775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.681265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.681722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.682897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:57.682897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:57.683341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:57.824441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:57.832465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2c1d7d99-f8d3-4e64-bceb-75d9455c3009 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1672 microversion: 2.1 time: 0.162796 Sep 29 02:23:57.833024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 490/990] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:23:57 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:23:58.861315 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:23:58.862623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:23:58.873829 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:58.874700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:58.875476 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:58.876660 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:23:58.877410 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:23:58.878123 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:23:59.034427 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:23:59.047020 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-11200323-6023-4ccf-abde-0346e0e5aa8f tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1672 microversion: 2.1 time: 0.192309 Sep 29 02:23:59.047971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 501/991] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:23:58 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:00.074049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:00.074922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:00.081666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:00.082300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:00.082782 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:00.083568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:00.084076 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:00.084579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:00.087606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:00.328593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:00.337187 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2601db0f-a6b3-4b15-904c-15d67e754185 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1672 microversion: 2.1 time: 0.267001 Sep 29 02:24:00.337881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 491/992] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:00 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1672 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:00.852963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-16046bd4-003b-4bc4-89b5-6fc0685ec43f req-c3c0d9c3-f678-49ee-8d61-470a0e0eb252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba17fd87-1d98-421f-8d5c-fa0a77b51165", "name": "network-vif-deleted", "tag": "28d1e650-93d3-4314-83bc-9645d4e3c23f"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:00.863394 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-16046bd4-003b-4bc4-89b5-6fc0685ec43f req-c3c0d9c3-f678-49ee-8d61-470a0e0eb252 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:00.863880 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-16046bd4-003b-4bc4-89b5-6fc0685ec43f req-c3c0d9c3-f678-49ee-8d61-470a0e0eb252 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:00.864313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-16046bd4-003b-4bc4-89b5-6fc0685ec43f req-c3c0d9c3-f678-49ee-8d61-470a0e0eb252 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:00.876708 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-16046bd4-003b-4bc4-89b5-6fc0685ec43f req-c3c0d9c3-f678-49ee-8d61-470a0e0eb252 service nova] Creating event network-vif-deleted:28d1e650-93d3-4314-83bc-9645d4e3c23f for instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 on hv-cinder-73306 Sep 29 02:24:00.882152 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-16046bd4-003b-4bc4-89b5-6fc0685ec43f req-c3c0d9c3-f678-49ee-8d61-470a0e0eb252 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093740 Sep 29 02:24:00.882778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 502/993] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:01.349608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:01.350092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:01.359600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:01.360461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:01.361094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:01.362029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:01.362711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:01.363186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:01.363732 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:01.365100 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:01.380570 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:01.382258 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:01.382606 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:01.383564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:01.383981 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:01.384951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:01.394739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cd8bb94f-3021-430e-8a68-d8a12c00255c tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/ips" status: 200 len: 148 microversion: 2.1 time: 0.194745 Sep 29 02:24:01.395539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 492/994] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:24:01 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/ips => generated 148 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:01.422621 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:01.423114 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:01.423548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:01.424000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lazy-loading 'fault' on Instance uuid ba17fd87-1d98-421f-8d5c-fa0a77b51165 {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:24:01.470227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '480c3f60b5e14b5f93e5dc921694aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e72ef47313ef4a8582a9e060d5597fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:01.482800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d15ca5ff-be62-467d-bd1e-25996cd5d1ec tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 200 len: 1327 microversion: 2.1 time: 0.122839 Sep 29 02:24:01.485000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 503/995] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:01 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:02.514741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:02.515826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:02.527473 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:02.528376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:02.529098 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:02.530268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:02.530986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:02.531724 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:02.549044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] HTTP exception thrown: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Request method failure captured: Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 HTTP/1.1 Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8eOrsiwhrlXV7KBrjfHN_v1unsD6tq2BBdrhLhPG4qZDLBFn5YCxnGZwK6nJi9oDGvQu8UHWBbmQYa48QUQDRrzHkl100xSmAJ4kI3hzFyHQvx-ytgxkOdz7CWDcSPc7V_-F1DOq93hguaV6qDXxtrBCsObHDfx0d-PAPRH2XfhOw Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:02.550736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 480c3f60b5e14b5f93e5dc921694aee4 Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:02.552408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': 'ba17fd87-1d98-421f-8d5c-fa0a77b51165'} Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:02.553246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:02.554628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:02.556703 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Returning 404 to user: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:02.556703 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7ab9473b-9f63-4110-99a3-f8dc9507d32a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 404 len: 111 microversion: 2.1 time: 0.044892 Sep 29 02:24:02.556703 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 493/996] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:02 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:02.562020 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-4757aad3-5006-4c85-9dd2-f9a81c49383e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '.version_select at 0x7f404dc740d0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:02.584084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-4757aad3-5006-4c85-9dd2-f9a81c49383e tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106415331" status: 202 len: 0 microversion: 2.1 time: 0.026043 Sep 29 02:24:02.584850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 504/997] 10.222.0.61 () {58 vars in 1218 bytes} [Thu Sep 29 02:24:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106415331 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:24:02.801896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "389f8dbe-c0de-459c-83ae-be0d41d98326"}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:02.804816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:02.811787 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:02.812364 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:02.813307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:02.814080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:02.814722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:02.815307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:03.095876 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e6149738-422c-487b-9ba7-15453736198d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "POST /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297901 Sep 29 02:24:03.096579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 494/998] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 29 02:24:02 2022] POST /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:05.517135 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:05.517656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:05.519602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:05.526157 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:05.526611 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:05.527061 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:05.527828 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:05.528286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:05.528700 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:05.531939 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:05.545518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] HTTP exception thrown: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Request method failure captured: Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 HTTP/1.1 Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8eOrsiwhrlXV7KBrjfHN_v1unsD6tq2BBdrhLhPG4qZDLBFn5YCxnGZwK6nJi9oDGvQu8UHWBbmQYa48QUQDRrzHkl100xSmAJ4kI3hzFyHQvx-ytgxkOdz7CWDcSPc7V_-F1DOq93hguaV6qDXxtrBCsObHDfx0d-PAPRH2XfhOw Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:05.547235 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 480c3f60b5e14b5f93e5dc921694aee4 Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.548911 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': 'ba17fd87-1d98-421f-8d5c-fa0a77b51165'} Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:05.549951 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.552145 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.553815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Returning 404 to user: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:05.553815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e05e7c8c-a0f6-4b6c-852f-5fd7a00bfa39 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 404 len: 111 microversion: 2.1 time: 0.036101 Sep 29 02:24:05.553815 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 505/999] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:05 2022] DELETE /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:05.558707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:05.559406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: ba17fd87-1d98-421f-8d5c-fa0a77b51165] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:05.565768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:05.566297 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:05.566707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:05.567399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:05.567857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:05.568285 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:05.581729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] HTTP exception thrown: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Request method failure captured: Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 HTTP/1.1 Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8eOrsiwhrlXV7KBrjfHN_v1unsD6tq2BBdrhLhPG4qZDLBFn5YCxnGZwK6nJi9oDGvQu8UHWBbmQYa48QUQDRrzHkl100xSmAJ4kI3hzFyHQvx-ytgxkOdz7CWDcSPc7V_-F1DOq93hguaV6qDXxtrBCsObHDfx0d-PAPRH2XfhOw Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:05.583377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 480c3f60b5e14b5f93e5dc921694aee4 Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.584931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': 'ba17fd87-1d98-421f-8d5c-fa0a77b51165'} Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:05.585807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. Sep 29 02:24:05.587275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:05.588688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Returning 404 to user: Instance ba17fd87-1d98-421f-8d5c-fa0a77b51165 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:05.588688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a4e12528-53ac-4a85-b7d5-5433a64e594b tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165" status: 404 len: 111 microversion: 2.1 time: 0.031107 Sep 29 02:24:05.588688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 495/1000] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:05 2022] GET /compute/v2.1/servers/ba17fd87-1d98-421f-8d5c-fa0a77b51165 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:06.755204 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:06.755712 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:06.763763 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:06.764250 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:06.764681 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:06.765378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:06.765831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:06.766290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:06.780579 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] HTTP exception thrown: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Request method failure captured: Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad HTTP/1.1 Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8eOrsiwhrlXV7KBrjfHN_v1unsD6tq2BBdrhLhPG4qZDLBFn5YCxnGZwK6nJi9oDGvQu8UHWBbmQYa48QUQDRrzHkl100xSmAJ4kI3hzFyHQvx-ytgxkOdz7CWDcSPc7V_-F1DOq93hguaV6qDXxtrBCsObHDfx0d-PAPRH2XfhOw Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:06.782187 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: 480c3f60b5e14b5f93e5dc921694aee4 Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.783774 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '122ad38e-8b7c-440d-99ab-e3c7063691ad'} Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:06.784663 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.786229 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.787691 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Returning 404 to user: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:06.787691 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0ade7795-ccb5-4580-a4c0-e823a857fd0a tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 404 len: 111 microversion: 2.1 time: 0.032675 Sep 29 02:24:06.787691 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 506/1001] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:06 2022] DELETE /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:06.792795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:06.793430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] [instance: 122ad38e-8b7c-440d-99ab-e3c7063691ad] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:06.795911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=24 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:06.801493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:06.801975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:06.802431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:06.803132 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:06.803583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:06.804005 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:06.818258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] HTTP exception thrown: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Request method failure captured: Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad HTTP/1.1 Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8eOrsiwhrlXV7KBrjfHN_v1unsD6tq2BBdrhLhPG4qZDLBFn5YCxnGZwK6nJi9oDGvQu8UHWBbmQYa48QUQDRrzHkl100xSmAJ4kI3hzFyHQvx-ytgxkOdz7CWDcSPc7V_-F1DOq93hguaV6qDXxtrBCsObHDfx0d-PAPRH2XfhOw Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:06.819890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e72ef47313ef4a8582a9e060d5597fc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e72ef47313ef4a8582a9e060d5597fc0 Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1312439490 Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 480c3f60b5e14b5f93e5dc921694aee4 Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeTestJSON-1312439490-project Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.821403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '122ad38e-8b7c-440d-99ab-e3c7063691ad'} Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:06.822243 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. Sep 29 02:24:06.824052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:06.825164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] Returning 404 to user: Instance 122ad38e-8b7c-440d-99ab-e3c7063691ad could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:06.825164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-228a9e69-fc09-41a0-bafb-4e44d393b4a6 tempest-AttachVolumeTestJSON-1312439490 tempest-AttachVolumeTestJSON-1312439490-project] 10.222.0.61 "GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad" status: 404 len: 111 microversion: 2.1 time: 0.032752 Sep 29 02:24:06.825164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 496/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:06 2022] GET /compute/v2.1/servers/122ad38e-8b7c-440d-99ab-e3c7063691ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 29 02:24:10.815957 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:10.816553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:10.823104 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:10.823635 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:10.824066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:10.824915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:10.825497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:10.825787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:10.909491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'services' on Instance uuid 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:24:10.985343 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-245b2ef5-283d-4583-87d2-585fbecfb249 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments/389f8dbe-c0de-459c-83ae-be0d41d98326" status: 202 len: 0 microversion: 2.1 time: 0.173199 Sep 29 02:24:10.986156 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 507/1003] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 29 02:24:10 2022] DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments/389f8dbe-c0de-459c-83ae-be0d41d98326 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:24:10.994882 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:10.997249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:11.010621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:11.011398 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:11.011836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:11.012542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:11.012989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:11.013406 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:11.047648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fc7b18b7-c7bd-46df-8c93-bc675dc8562b tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056686 Sep 29 02:24:11.048202 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 497/1004] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:24:10 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:12.061332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:12.063702 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:12.070411 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:12.070898 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:12.071330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:12.072045 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:12.072504 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:12.072915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:12.102520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d457b4d8-589f-4564-a8c0-aeca4d60ad65 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046010 Sep 29 02:24:12.103200 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 508/1005] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 29 02:24:12 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 29 02:24:12.168369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:12.168945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:12.175424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:12.175895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:12.176309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:12.177016 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:12.177448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:12.177870 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:12.205864 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:24:12.285375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-36832615-65bf-4730-9f27-af01d2751d5d tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 204 len: 0 microversion: 2.1 time: 0.120618 Sep 29 02:24:12.285928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 498/1006] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:12 2022] DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:24:12.295151 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:12.295927 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:12.302387 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:12.302883 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:12.303322 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:12.304028 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:12.304971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:12.304971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:12.439581 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:12.447400 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-2ea19b40-010d-4a68-8470-504f13aab955 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1681 microversion: 2.1 time: 0.156355 Sep 29 02:24:12.447969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 509/1007] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:12 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:13.472132 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:13.472827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:13.479260 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:13.480568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:13.481004 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:13.481731 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:13.482299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:13.482719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:13.634692 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:13.643214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-79708345-0b4b-41fd-9a7c-859250114913 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1681 microversion: 2.1 time: 0.175493 Sep 29 02:24:13.643778 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 499/1008] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:13 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:14.666333 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:14.667574 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:14.675055 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:14.675558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:14.676227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:14.677434 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:14.677894 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:14.678347 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:14.816077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:14.824928 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-be8170d5-b2f5-4411-bb4a-ae871e0c0389 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1681 microversion: 2.1 time: 0.162562 Sep 29 02:24:14.825510 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 510/1009] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:14 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:15.263412 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8e85d4f3-d373-4579-98a2-6de64c8b8bd9 req-1a2f569c-0c1d-4c58-b935-1a68eca581a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e", "name": "network-vif-deleted", "tag": "5fd5d443-9b1d-486c-b4c4-501c962f12ee"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:15.277766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e85d4f3-d373-4579-98a2-6de64c8b8bd9 req-1a2f569c-0c1d-4c58-b935-1a68eca581a4 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:15.278604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e85d4f3-d373-4579-98a2-6de64c8b8bd9 req-1a2f569c-0c1d-4c58-b935-1a68eca581a4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:15.279272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8e85d4f3-d373-4579-98a2-6de64c8b8bd9 req-1a2f569c-0c1d-4c58-b935-1a68eca581a4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:15.297863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8e85d4f3-d373-4579-98a2-6de64c8b8bd9 req-1a2f569c-0c1d-4c58-b935-1a68eca581a4 service nova] Creating event network-vif-deleted:5fd5d443-9b1d-486c-b4c4-501c962f12ee for instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e on hv-cinder-73306 Sep 29 02:24:15.304526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8e85d4f3-d373-4579-98a2-6de64c8b8bd9 req-1a2f569c-0c1d-4c58-b935-1a68eca581a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046336 Sep 29 02:24:15.305591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 500/1010] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:24:15.850175 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:15.851464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:15.861075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:15.861673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:15.862138 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:15.863309 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:15.864164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:15.864999 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:15.911208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:15.912101 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:15.912755 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:15.913466 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lazy-loading 'fault' on Instance uuid 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:24:15.966814 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6111a16f95d4bc58f84d9f60f703d80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9006f0bb109c4c96a387ff5c314f236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:15.978806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1daad529-3959-4435-ba8f-7dfd22c7c7e1 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 200 len: 1332 microversion: 2.1 time: 0.133599 Sep 29 02:24:15.980108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 511/1011] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:15 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:17.004761 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:17.005463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:17.012355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:17.012842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:17.013309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:17.014127 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:17.014568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:17.015148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:17.029400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e HTTP/1.1 Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:17.031117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:17.032816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e'} Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:17.034123 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:17.035678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:17.037504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:17.037504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-099e24ab-58d1-4eec-920b-42090837e7f5 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 404 len: 111 microversion: 2.1 time: 0.032619 Sep 29 02:24:17.037504 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 501/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:16 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:17.041889 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-344f6763-1f41-46ec-ae40-dcb3118db594 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '.version_select at 0x7f404d877af0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:17.064651 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-344f6763-1f41-46ec-ae40-dcb3118db594 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303224747" status: 202 len: 0 microversion: 2.1 time: 0.026722 Sep 29 02:24:17.065395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 512/1013] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 29 02:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303224747 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:24:18.855038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:18.855569 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:18.862433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:18.862936 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:18.863373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:18.864095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:18.864545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:18.864969 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:18.878538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e HTTP/1.1 Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:18.880072 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.881992 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e'} Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:18.883471 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.884961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.887240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:18.887240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ced89a54-e7bf-4301-8d37-33533a82a55e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 404 len: 111 microversion: 2.1 time: 0.030296 Sep 29 02:24:18.887240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 502/1014] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:18 2022] DELETE /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:18.891420 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:18.892038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:18.898795 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:18.899281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:18.899719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:18.900419 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:18.900872 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:18.901291 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:18.914945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e HTTP/1.1 Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:18.916639 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.918332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e'} Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:18.919692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. Sep 29 02:24:18.921253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:18.922548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:18.922548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-fdf2531a-2c31-433c-b8be-4f4768c27847 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e" status: 404 len: 111 microversion: 2.1 time: 0.031218 Sep 29 02:24:18.922548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 513/1015] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:18 2022] GET /compute/v2.1/servers/8b958e3c-1cb6-4b8d-9ad2-0a2b4b765d3e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:20.067487 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:20.067986 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:20.074656 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.075131 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.075578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.076245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.076686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.077100 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.090529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 HTTP/1.1 Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:20.092430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.094049 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '2dd20e5a-93ae-453e-95fd-de7659e3f700'} Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:20.094887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.096167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.097433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:20.097433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-185e5594-f71d-4e2f-92b4-3fb75f7e0956 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 404 len: 111 microversion: 2.1 time: 0.030331 Sep 29 02:24:20.097433 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 503/1016] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:20 2022] DELETE /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:20.102458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:20.103071 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 2dd20e5a-93ae-453e-95fd-de7659e3f700] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:20.109899 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.110517 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.110993 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.111661 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.112095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.112513 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.126384 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 HTTP/1.1 Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:20.127923 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.129642 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '2dd20e5a-93ae-453e-95fd-de7659e3f700'} Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:20.130595 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. Sep 29 02:24:20.132163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.133528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 2dd20e5a-93ae-453e-95fd-de7659e3f700 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:20.133528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-13828fed-6c62-4c0c-81d5-d8b61c122fd9 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700" status: 404 len: 111 microversion: 2.1 time: 0.030683 Sep 29 02:24:20.133528 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 514/1017] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:20 2022] GET /compute/v2.1/servers/2dd20e5a-93ae-453e-95fd-de7659e3f700 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:20.138457 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:20.138915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:20.144824 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.145417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.145845 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.146560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.147004 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.147411 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.161036 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d HTTP/1.1 Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:20.162614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.164303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': 'd17caae6-a830-4120-a14f-0f01c7d6c39d'} Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:20.165092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.166514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.167808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:20.167808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2cdab6f0-b8ba-442f-9f3a-76ce79e9b352 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 404 len: 111 microversion: 2.1 time: 0.030019 Sep 29 02:24:20.167808 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 504/1018] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:20 2022] DELETE /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:20.173027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:20.173636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: d17caae6-a830-4120-a14f-0f01c7d6c39d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:20.179652 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.180129 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.180558 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.181240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:20.181688 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:20.182133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:20.197193 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d HTTP/1.1 Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:20.198836 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.201916 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': 'd17caae6-a830-4120-a14f-0f01c7d6c39d'} Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:20.203468 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. Sep 29 02:24:20.205313 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:20.206725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance d17caae6-a830-4120-a14f-0f01c7d6c39d could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:20.206725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-dc5074ab-6ec0-4a0b-a488-4d56e374048e tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d" status: 404 len: 111 microversion: 2.1 time: 0.031676 Sep 29 02:24:20.206725 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 515/1019] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:20 2022] GET /compute/v2.1/servers/d17caae6-a830-4120-a14f-0f01c7d6c39d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:21.361223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:21.361834 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:21.369063 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:21.369963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:21.369963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:21.370687 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:21.371138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:21.371565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:21.389207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c HTTP/1.1 Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:21.391311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.393021 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '87d6d291-847b-4e09-b49e-4c5ec0dfae6c'} Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:21.393907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.395610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.397376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:21.397376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c1090a22-233a-448f-a52b-338cf08796b7 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 404 len: 111 microversion: 2.1 time: 0.039013 Sep 29 02:24:21.397376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 505/1020] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:21 2022] DELETE /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:21.401451 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:21.402088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] [instance: 87d6d291-847b-4e09-b49e-4c5ec0dfae6c] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:21.408849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:21.409335 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:21.409770 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:21.410501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:21.410953 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:21.411378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:21.425606 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] HTTP exception thrown: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Request method failure captured: Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c HTTP/1.1 Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8bQTBYCbID-mOhlDjHtjT4EFwpNXQ8W3A1cgOz4JTTNKcR1gJ1cAUfpNJY9eOjX-iTwYl__TDeXcmxQySswNPhQK75fbm6UotKZXReb50LYlTiaS6jMYW7SJYv2Ls9MISYG_G-uIlBUejNOFvR2E2TGCZ3Nay4OOt8yphf3Yx6w7M Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:21.427165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9006f0bb109c4c96a387ff5c314f236e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 9006f0bb109c4c96a387ff5c314f236e Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1573826869 Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: a6111a16f95d4bc58f84d9f60f703d80 Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeNegativeTest-1573826869-project Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.428831 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '87d6d291-847b-4e09-b49e-4c5ec0dfae6c'} Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:21.429759 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. Sep 29 02:24:21.431281 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:21.433188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] Returning 404 to user: Instance 87d6d291-847b-4e09-b49e-4c5ec0dfae6c could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:21.433188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-033bf7be-74cc-4805-b4e5-9094c7c98b25 tempest-AttachVolumeNegativeTest-1573826869 tempest-AttachVolumeNegativeTest-1573826869-project] 10.222.0.61 "GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c" status: 404 len: 111 microversion: 2.1 time: 0.031049 Sep 29 02:24:21.433188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 516/1021] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:21 2022] GET /compute/v2.1/servers/87d6d291-847b-4e09-b49e-4c5ec0dfae6c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:22.888683 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-112251067", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "networks": [{"uuid": "2594207f-32e1-422d-a07b-06ac288a6300"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:22.948266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] validate_networks() for [('2594207f-32e1-422d-a07b-06ac288a6300', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:24:23.884774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:24:23.885452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:24:23.885967 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:24:23.886862 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:24:23.887279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:24:23.897214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:23.897921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:23.898128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:23.898842 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:23.899288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:23.899703 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:23.917003 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Getting quotas for project 04420159627d4beeb44bb038e633a96d. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:24:23.921344 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Getting quotas for user d83a16ba92834ab6a23a4b4634711178 and project 04420159627d4beeb44bb038e633a96d. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:24:23.932661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:24:23.935055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:24:23.985256 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-affbdbe0-950e-4eae-a5e6-cb68bcf31c81 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101199 Sep 29 02:24:23.992064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 506/1022] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:24:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:24:23.997406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5d0d700a-f86b-4a07-9f48-183881aa1f62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:23.998201 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-5d0d700a-f86b-4a07-9f48-183881aa1f62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:24.067543 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-5d0d700a-f86b-4a07-9f48-183881aa1f62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:24.074478 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5d0d700a-f86b-4a07-9f48-183881aa1f62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1213 microversion: 2.1 time: 0.080988 Sep 29 02:24:24.075050 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 517/1023] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:23 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:25.099530 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:25.100094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:25.106467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:25.107767 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:25.108213 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:25.108917 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:25.109375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:25.109801 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:25.174570 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:25.182576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3cfa0d53-b6da-407a-b349-90a2560bcfdf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1265 microversion: 2.1 time: 0.087585 Sep 29 02:24:25.183403 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 507/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:25 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:26.208171 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:26.208789 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:26.225519 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:26.226358 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:26.226969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:26.227857 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:26.228480 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:26.229066 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:26.421263 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:26.437127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-611d956d-e967-4205-8e16-5761a26a71e5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.233923 Sep 29 02:24:26.437797 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 518/1025] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:26 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:26.696547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1e6777d2-5db7-4ed1-9d42-513ff26837b8 req-865bafe4-a56b-4633-9963-4ce2fdd1474f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "698750ca-07c1-4cf0-aa73-32dfe141804f", "tag": "4b55f185-6905-47a0-a7e4-c463d619813c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:26.708362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e6777d2-5db7-4ed1-9d42-513ff26837b8 req-865bafe4-a56b-4633-9963-4ce2fdd1474f service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:26.709025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e6777d2-5db7-4ed1-9d42-513ff26837b8 req-865bafe4-a56b-4633-9963-4ce2fdd1474f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:26.709583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1e6777d2-5db7-4ed1-9d42-513ff26837b8 req-865bafe4-a56b-4633-9963-4ce2fdd1474f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:26.722893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1e6777d2-5db7-4ed1-9d42-513ff26837b8 req-865bafe4-a56b-4633-9963-4ce2fdd1474f service nova] Creating event network-changed:4b55f185-6905-47a0-a7e4-c463d619813c for instance 698750ca-07c1-4cf0-aa73-32dfe141804f on hv-cinder-73306 Sep 29 02:24:26.728112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1e6777d2-5db7-4ed1-9d42-513ff26837b8 req-865bafe4-a56b-4633-9963-4ce2fdd1474f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035689 Sep 29 02:24:26.728994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 508/1026] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:27.460894 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:27.461502 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:27.468117 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:27.468594 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:27.469021 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:27.469717 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:27.470191 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:27.470608 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:27.906351 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:27.914748 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-b4a00cbb-2e67-4eab-86cb-573b0451ccce tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.457851 Sep 29 02:24:27.915515 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 519/1027] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:27 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:28.940309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:28.940920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:28.947517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:28.947997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:28.948394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:28.949119 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:28.949572 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:28.949994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.160409 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:29.162717 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:29.169687 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:29.170366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:29.170868 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.171644 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:29.172168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:29.172685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.190857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:29.199908 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-30f85a3e-41b8-44c4-9185-add3a699a800 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.264492 Sep 29 02:24:29.201052 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 509/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:28 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:29.204209 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-ee3826e7-d254-4ed7-a98b-6d35418853a5 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047950 Sep 29 02:24:29.204945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 520/1029] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 29 02:24:29 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:29.284561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:29.285080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:29.293189 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:29.293672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:29.294707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.296280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:29.297423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:29.298210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.323631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:24:29.381634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:29.416968 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1cc0f04b-429b-478d-b0a7-2d87088526f8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 204 len: 0 microversion: 2.20 time: 0.142016 Sep 29 02:24:29.417561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 510/1030] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 29 02:24:29 2022] DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 29 02:24:29.426545 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:29.427306 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:29.433312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:29.433871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:29.434405 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.435221 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:29.435779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:29.436266 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:29.581473 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:29.589984 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:29.591673 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:29.592855 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c25c888b-60e1-4960-8431-d2c11b1cec73 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.170299 Sep 29 02:24:29.593432 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 521/1031] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:29 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:24:30.224053 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:30.224729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:30.232643 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:30.233369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:30.234140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:30.235609 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:30.236226 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:30.236854 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:30.386286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:30.394637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0ec7c2b-7aff-4d51-812d-e85b5cf115e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.174870 Sep 29 02:24:30.395187 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 511/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:30 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:30.618183 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:30.620599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:30.628518 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:30.629271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:30.629849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:30.630741 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:30.631366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:30.631938 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:30.802967 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:30.819271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:30.820793 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:30.822169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-43f42e75-f624-4a4a-b333-097836ab66b0 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.207976 Sep 29 02:24:30.826787 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 522/1033] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:30 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:24:31.421019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:31.423026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:31.430333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:31.431121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:31.431555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:31.432661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:31.433308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:31.434101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:31.689141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:31.713553 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5da42480-0e36-43d8-9878-87f00fb032cf tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.299318 Sep 29 02:24:31.730916 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 512/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:31 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:31.851485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:31.853102 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:31.865077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:31.865864 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:31.866601 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:31.867311 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:31.868294 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:31.868912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:32.035919 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:32.045783 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:32.047393 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:32.049035 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-f43ea3ec-6e6c-462c-ae1b-dce5d2365c83 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1721 microversion: 2.20 time: 0.203754 Sep 29 02:24:32.050739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 523/1035] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:31 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:24:32.450843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2d723a3d-b38a-4345-9435-e7e2cc66f074 req-5645d88a-1a6c-4928-95f4-a5cce628118e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f58670-0230-4d73-8f7f-c3de3e04856d", "name": "network-vif-deleted", "tag": "998a6c9b-b071-42d6-9c61-c534536f1b8e"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:32.462235 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2d723a3d-b38a-4345-9435-e7e2cc66f074 req-5645d88a-1a6c-4928-95f4-a5cce628118e service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:32.463057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2d723a3d-b38a-4345-9435-e7e2cc66f074 req-5645d88a-1a6c-4928-95f4-a5cce628118e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:32.463765 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2d723a3d-b38a-4345-9435-e7e2cc66f074 req-5645d88a-1a6c-4928-95f4-a5cce628118e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:32.478704 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2d723a3d-b38a-4345-9435-e7e2cc66f074 req-5645d88a-1a6c-4928-95f4-a5cce628118e service nova] Creating event network-vif-deleted:998a6c9b-b071-42d6-9c61-c534536f1b8e for instance 56f58670-0230-4d73-8f7f-c3de3e04856d on hv-cinder-73306 Sep 29 02:24:32.484480 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2d723a3d-b38a-4345-9435-e7e2cc66f074 req-5645d88a-1a6c-4928-95f4-a5cce628118e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037642 Sep 29 02:24:32.485648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 513/1036] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:32.740026 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:32.740643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:32.747361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:32.749164 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:32.749590 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:32.750327 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:32.751127 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:32.751864 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:32.910739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:32.926440 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d0ddb26b-8b7a-4d28-a28c-b3ab4712cd79 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.190532 Sep 29 02:24:32.927027 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 524/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:32 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:33.078336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:33.079485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:33.092187 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:33.092187 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:33.092593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:33.094506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:33.095604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:33.096064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:33.143408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:33.143881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:33.144313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:33.144788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lazy-loading 'fault' on Instance uuid 56f58670-0230-4d73-8f7f-c3de3e04856d {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:24:33.194680 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:33.212860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:33.212860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd0ed4854e0d449e58d09487fe8eedc2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad99e285720d41988cf2cf8f8978c313', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:33.213240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fbd1bb42-5e34-40c3-99f3-304f5d544dd8 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 200 len: 1371 microversion: 2.20 time: 0.139683 Sep 29 02:24:33.213688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 514/1038] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:33 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 1371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 29 02:24:33.910853 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-af274ffd-1cf8-41be-b529-6c70bc239173 req-5764bcc2-d4c7-4dab-aba2-6b4188dbc4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698750ca-07c1-4cf0-aa73-32dfe141804f", "name": "network-vif-plugged", "status": "completed", "tag": "4b55f185-6905-47a0-a7e4-c463d619813c"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:33.925850 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-af274ffd-1cf8-41be-b529-6c70bc239173 req-5764bcc2-d4c7-4dab-aba2-6b4188dbc4ee service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:33.926354 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-af274ffd-1cf8-41be-b529-6c70bc239173 req-5764bcc2-d4c7-4dab-aba2-6b4188dbc4ee service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:33.926662 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-af274ffd-1cf8-41be-b529-6c70bc239173 req-5764bcc2-d4c7-4dab-aba2-6b4188dbc4ee service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:33.940312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-af274ffd-1cf8-41be-b529-6c70bc239173 req-5764bcc2-d4c7-4dab-aba2-6b4188dbc4ee service nova] Creating event network-vif-plugged:4b55f185-6905-47a0-a7e4-c463d619813c for instance 698750ca-07c1-4cf0-aa73-32dfe141804f on hv-cinder-73306 Sep 29 02:24:33.947096 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-af274ffd-1cf8-41be-b529-6c70bc239173 req-5764bcc2-d4c7-4dab-aba2-6b4188dbc4ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174756 Sep 29 02:24:33.947692 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 525/1039] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:33.951064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:33.951727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:33.955086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:33.955715 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=6 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:33.959779 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:33.960428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:33.960853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:33.961577 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:33.962038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:33.962459 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:34.107617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:34.122114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3f375c5e-a1ba-401d-8d08-0a7f98bafd62 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.175217 Sep 29 02:24:34.123101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 515/1040] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:33 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:34.237357 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:34.241602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:34.242390 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:34.249466 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:34.249949 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:34.250417 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:34.251201 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:34.251566 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:34.251992 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:34.266930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] HTTP exception thrown: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Request method failure captured: Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d HTTP/1.1 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8lCqVsvNOdKq8kRPqRgmbs-7Rb-jmAaRgMNqqFwjfnQm2HMp5AWTaMExt8RfAqUNlwcKA6yamo5oXRHWS9UY1O5GQhU8NkCfp_xIQ6SoE70on7cLq7OFXtuncJqWfK3Fx0kTqqyWuBLMC_XCcuP7wG4rJ-c4edZo8sRXLZmhI6xIg Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Openstack-Nova-Api-Version: 2.20 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:34.268605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: d0ed4854e0d449e58d09487fe8eedc2c Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:34.270038 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '56f58670-0230-4d73-8f7f-c3de3e04856d'} Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:34.270878 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:34.272254 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:34.273395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Returning 404 to user: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:34.273395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-59221d0d-56b0-4734-9011-e953e0848552 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 404 len: 111 microversion: 2.20 time: 0.033559 Sep 29 02:24:34.273395 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 526/1041] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:34 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:24:34.279441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cc6230c9-1c90-4fca-bb36-4eae698fd5f7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '.version_select at 0x7f404dae9790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:34.299873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cc6230c9-1c90-4fca-bb36-4eae698fd5f7 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386330061" status: 204 len: 0 microversion: 2.20 time: 0.024375 Sep 29 02:24:34.300521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 516/1042] 10.222.0.61 () {60 vars in 1262 bytes} [Thu Sep 29 02:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386330061 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 29 02:24:35.146438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:35.147084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:35.154032 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:35.154541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:35.154984 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:35.155690 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:35.156146 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:35.156936 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:35.329239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:35.337531 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e95d2954-021d-4119-ba16-ea096c3d03e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1313 microversion: 2.1 time: 0.195418 Sep 29 02:24:35.349915 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 527/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:35 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:36.079204 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:36.079690 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:36.086544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:36.087017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:36.087686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:36.088399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:36.088865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:36.089277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:36.103621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] HTTP exception thrown: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Request method failure captured: Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d HTTP/1.1 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8lCqVsvNOdKq8kRPqRgmbs-7Rb-jmAaRgMNqqFwjfnQm2HMp5AWTaMExt8RfAqUNlwcKA6yamo5oXRHWS9UY1O5GQhU8NkCfp_xIQ6SoE70on7cLq7OFXtuncJqWfK3Fx0kTqqyWuBLMC_XCcuP7wG4rJ-c4edZo8sRXLZmhI6xIg Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:36.105286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: d0ed4854e0d449e58d09487fe8eedc2c Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.106899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '56f58670-0230-4d73-8f7f-c3de3e04856d'} Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:36.108521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.109771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.111942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Returning 404 to user: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:36.111942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-00d7951e-23ee-4bd0-8ba5-a271733f3a72 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 404 len: 111 microversion: 2.20 time: 0.032023 Sep 29 02:24:36.111942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 517/1044] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 29 02:24:36 2022] DELETE /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 29 02:24:36.115669 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:36.116286 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 56f58670-0230-4d73-8f7f-c3de3e04856d] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:36.118189 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:36.123089 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:36.123616 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:36.124046 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:36.124751 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:36.125205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:36.125625 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:36.130382 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:36.141960 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] HTTP exception thrown: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Request method failure captured: Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d HTTP/1.1 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8lCqVsvNOdKq8kRPqRgmbs-7Rb-jmAaRgMNqqFwjfnQm2HMp5AWTaMExt8RfAqUNlwcKA6yamo5oXRHWS9UY1O5GQhU8NkCfp_xIQ6SoE70on7cLq7OFXtuncJqWfK3Fx0kTqqyWuBLMC_XCcuP7wG4rJ-c4edZo8sRXLZmhI6xIg Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Openstack-Nova-Api-Version: 2.20 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:36.143522 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: d0ed4854e0d449e58d09487fe8eedc2c Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.145085 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '56f58670-0230-4d73-8f7f-c3de3e04856d'} Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:36.145860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. Sep 29 02:24:36.147858 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:36.149643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Returning 404 to user: Instance 56f58670-0230-4d73-8f7f-c3de3e04856d could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:36.149643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-88408f18-086d-49c0-ab81-20be0bb16eb9 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d" status: 404 len: 111 microversion: 2.20 time: 0.033169 Sep 29 02:24:36.149643 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 528/1045] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:36 2022] GET /compute/v2.1/servers/56f58670-0230-4d73-8f7f-c3de3e04856d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 29 02:24:36.360987 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:36.362317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:36.368579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:36.369069 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:36.369499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:36.370238 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:36.370689 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:36.371120 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:36.507245 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:36.516434 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-df989257-34f7-42ca-925c-eb6c93721651 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1498 microversion: 2.1 time: 0.159976 Sep 29 02:24:36.516978 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 518/1046] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:36 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:37.046240 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:37.047199 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:37.053890 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.054362 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.054843 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.055525 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.055963 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.056379 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.083852 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:24:37.166719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-af6b83d3-586e-458d-a9bd-43b4ba3a7757 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "DELETE /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 204 len: 0 microversion: 2.1 time: 0.124204 Sep 29 02:24:37.167426 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 529/1047] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:37 2022] DELETE /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:24:37.175890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:37.176605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:37.179027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:37.184353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.184912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.185399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.186280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.186981 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.187465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.303532 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:37.304113 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:37.310553 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.311257 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.311685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.312501 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.313044 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.313654 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.329188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] HTTP exception thrown: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Request method failure captured: Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 HTTP/1.1 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNP8lCqVsvNOdKq8kRPqRgmbs-7Rb-jmAaRgMNqqFwjfnQm2HMp5AWTaMExt8RfAqUNlwcKA6yamo5oXRHWS9UY1O5GQhU8NkCfp_xIQ6SoE70on7cLq7OFXtuncJqWfK3Fx0kTqqyWuBLMC_XCcuP7wG4rJ-c4edZo8sRXLZmhI6xIg Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Openstack-Nova-Api-Version: 2.20 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:37.330901 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: d0ed4854e0d449e58d09487fe8eedc2c Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.332844 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '4e1ae6d6-9e31-4e27-ae16-171415ade1c1'} Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:37.333956 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.335624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.338529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Returning 404 to user: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:37.339051 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:37.339548 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c7b1b4da-cba6-41b9-992e-cea5f505df1e tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 404 len: 111 microversion: 2.20 time: 0.040293 Sep 29 02:24:37.348094 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-41145fae-d45f-4f7d-b7ec-6eea55d5db77 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1504 microversion: 2.1 time: 0.176172 Sep 29 02:24:37.348649 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 519/1048] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:37 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:37.350273 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 530/1049] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 29 02:24:37 2022] DELETE /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 29 02:24:37.358342 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:37.359095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] [instance: 4e1ae6d6-9e31-4e27-ae16-171415ade1c1] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:37.365060 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.365610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.366142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.366899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:37.367413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:37.367898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:37.382343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] HTTP exception thrown: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Request method failure captured: Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 HTTP/1.1 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNP8lCqVsvNOdKq8kRPqRgmbs-7Rb-jmAaRgMNqqFwjfnQm2HMp5AWTaMExt8RfAqUNlwcKA6yamo5oXRHWS9UY1O5GQhU8NkCfp_xIQ6SoE70on7cLq7OFXtuncJqWfK3Fx0kTqqyWuBLMC_XCcuP7wG4rJ-c4edZo8sRXLZmhI6xIg Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Openstack-Nova-Api-Version: 2.20 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:37.383946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ad99e285720d41988cf2cf8f8978c313"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: ad99e285720d41988cf2cf8f8978c313 Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1823935959 Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: d0ed4854e0d449e58d09487fe8eedc2c Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1823935959-project Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.385430 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '4e1ae6d6-9e31-4e27-ae16-171415ade1c1'} Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:37.386296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. Sep 29 02:24:37.387974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:37.389248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] Returning 404 to user: Instance 4e1ae6d6-9e31-4e27-ae16-171415ade1c1 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:37.389248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-915017b5-1792-4cff-b8d2-3094499e2c03 tempest-AttachVolumeShelveTestJSON-1823935959 tempest-AttachVolumeShelveTestJSON-1823935959-project] 10.222.0.61 "GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1" status: 404 len: 111 microversion: 2.20 time: 0.031060 Sep 29 02:24:37.389248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 520/1050] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 29 02:24:37 2022] GET /compute/v2.1/servers/4e1ae6d6-9e31-4e27-ae16-171415ade1c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 29 02:24:38.371559 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:38.372253 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:38.379075 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:38.379565 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:38.380000 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:38.380685 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:38.381150 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:38.381561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:38.606860 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:38.614881 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-0d8b7e22-768b-49e6-ac3a-87e1744a271e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1504 microversion: 2.1 time: 0.247367 Sep 29 02:24:38.615448 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 531/1051] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:38 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:39.292935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-13bc788a-e9d8-4832-acab-a1fa39b9c437 req-da1cb4df-074a-4ef3-82ad-7d64ef754dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "698750ca-07c1-4cf0-aa73-32dfe141804f", "name": "network-vif-deleted", "tag": "4b55f185-6905-47a0-a7e4-c463d619813c"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:39.311664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13bc788a-e9d8-4832-acab-a1fa39b9c437 req-da1cb4df-074a-4ef3-82ad-7d64ef754dc4 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:39.312607 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13bc788a-e9d8-4832-acab-a1fa39b9c437 req-da1cb4df-074a-4ef3-82ad-7d64ef754dc4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:39.313110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-13bc788a-e9d8-4832-acab-a1fa39b9c437 req-da1cb4df-074a-4ef3-82ad-7d64ef754dc4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:39.339959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-13bc788a-e9d8-4832-acab-a1fa39b9c437 req-da1cb4df-074a-4ef3-82ad-7d64ef754dc4 service nova] Creating event network-vif-deleted:4b55f185-6905-47a0-a7e4-c463d619813c for instance 698750ca-07c1-4cf0-aa73-32dfe141804f on hv-cinder-73306 Sep 29 02:24:39.355774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-13bc788a-e9d8-4832-acab-a1fa39b9c437 req-da1cb4df-074a-4ef3-82ad-7d64ef754dc4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065268 Sep 29 02:24:39.356873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 521/1052] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:39.638217 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:39.638819 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:39.645849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:39.646368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:39.646802 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:39.647507 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:39.647959 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:39.648382 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:39.683641 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:39.684387 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:39.685006 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:39.685457 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.objects.instance [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lazy-loading 'fault' on Instance uuid 698750ca-07c1-4cf0-aa73-32dfe141804f {{(pid=120699) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:24:40.040747 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:40.049344 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-dc2564e4-a41d-4c3d-bdc8-54e1e6c3ed01 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 200 len: 1303 microversion: 2.1 time: 0.415428 Sep 29 02:24:40.049930 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 532/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:39 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 1303 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:41.072639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:41.073337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 698750ca-07c1-4cf0-aa73-32dfe141804f] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:41.080150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:41.080628 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:41.081055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:41.081741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:41.082218 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:41.082641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:41.098511 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] HTTP exception thrown: Instance 698750ca-07c1-4cf0-aa73-32dfe141804f could not be found. Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Request method failure captured: Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f HTTP/1.1 Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQHVvjCfy8duXJbii1TgiCXR8QXVkVlAPKQkrjhhPTlvKUPxDyTBPAKO1VBMR4Q65avxF7hX33skfLCqeGJjvc7c7seR1Wvk18ON0AOvjEXcc2EUeNGUJcfWP3UYFX8ioFiLpGjImBr7OB0l6vCVp7Si3Yj-cPA5sCFeRM2IzQDWt-s Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 04420159627d4beeb44bb038e633a96d Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesActionsTest-1219425692 Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:41.100169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/04420159627d4beeb44bb038e633a96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/04420159627d4beeb44bb038e633a96d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/04420159627d4beeb44bb038e633a96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_04420159627d4beeb44bb038e633a96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesActionsTest-1219425692 Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 04420159627d4beeb44bb038e633a96d Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesActionsTest-1219425692 Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesActionsTest-1219425692-project Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: d83a16ba92834ab6a23a4b4634711178 Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesActionsTest-1219425692-project Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 698750ca-07c1-4cf0-aa73-32dfe141804f could not be found. Sep 29 02:24:41.101653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '698750ca-07c1-4cf0-aa73-32dfe141804f'} Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 698750ca-07c1-4cf0-aa73-32dfe141804f could not be found. Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:41.102513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 698750ca-07c1-4cf0-aa73-32dfe141804f could not be found. Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 698750ca-07c1-4cf0-aa73-32dfe141804f could not be found. Sep 29 02:24:41.103900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:41.105081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Returning 404 to user: Instance 698750ca-07c1-4cf0-aa73-32dfe141804f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:41.105081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-aa6a9b9d-ccf8-4fab-b96e-8aa27bc51855 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f" status: 404 len: 111 microversion: 2.1 time: 0.033139 Sep 29 02:24:41.105081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 522/1054] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:41 2022] GET /compute/v2.1/servers/698750ca-07c1-4cf0-aa73-32dfe141804f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:24:41.200718 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1878242962", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452", "networks": [{"uuid": "2594207f-32e1-422d-a07b-06ac288a6300"}]}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:41.255205 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] validate_networks() for [('2594207f-32e1-422d-a07b-06ac288a6300', None, None, None, None, None)] {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:24:41.642169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Flavor limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:24:41.642813 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Image limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:24:41.643371 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Flavor pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:24:41.643849 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Image pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:24:41.644330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:24:41.653612 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:41.654182 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:41.654777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:41.655689 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:41.656163 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:41.656573 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:41.673401 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Getting quotas for project 04420159627d4beeb44bb038e633a96d. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:24:41.677444 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Getting quotas for user d83a16ba92834ab6a23a4b4634711178 and project 04420159627d4beeb44bb038e633a96d. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:24:41.688719 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Going to run 1 instances... {{(pid=120699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:24:41.691067 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:24:41.741839 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1dbd872b-b763-4abc-8b98-7cdeaa3163e8 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544813 Sep 29 02:24:41.743031 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 533/1055] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:24:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:24:41.754618 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8a3d9c8e-716d-47de-b84d-c3d2eb9f42db tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:41.755223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8a3d9c8e-716d-47de-b84d-c3d2eb9f42db tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:41.822733 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8a3d9c8e-716d-47de-b84d-c3d2eb9f42db tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:41.830701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8a3d9c8e-716d-47de-b84d-c3d2eb9f42db tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1214 microversion: 2.1 time: 0.079934 Sep 29 02:24:41.831272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 523/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:41 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:42.198190 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5c230f58-eaa8-4dc9-8c3d-15406eff0e0e tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Action: 'create', calling method: .version_select at 0x7f404dacb820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1572225191", "metadata": {"Type": "work"}}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:42.533005 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5c230f58-eaa8-4dc9-8c3d-15406eff0e0e tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.462464 Sep 29 02:24:42.533739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 534/1057] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 29 02:24:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 29 02:24:42.551437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-0757def6-e7b4-4a27-a9d8-0493d9f0a035 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Calling method '.version_select at 0x7f404d87d430>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:42.608555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-0757def6-e7b4-4a27-a9d8-0493d9f0a035 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f" status: 200 len: 353 microversion: 2.1 time: 0.065534 Sep 29 02:24:42.610046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 524/1058] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:42 2022] GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:42.855572 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:42.856222 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:42.870492 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:42.871475 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:42.877119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:42.878158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:42.878778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:42.879402 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:42.970324 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:42.980065 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-61e9b9d5-34e4-4532-8d66-7dbda5cf1b3a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1266 microversion: 2.1 time: 0.128731 Sep 29 02:24:42.980638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 535/1059] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:42 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:43.632526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-935cb8de-0300-42d6-8a45-0093e35511f5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Calling method '.version_select at 0x7f404df144c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:43.692585 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-935cb8de-0300-42d6-8a45-0093e35511f5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f" status: 200 len: 354 microversion: 2.1 time: 0.072895 Sep 29 02:24:43.693275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 525/1060] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:43 2022] GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:43.706162 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-5195548c-5836-4892-8e13-e7932099c2e1 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Calling method '.version_select at 0x7f404dd37280>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:43.756638 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-5195548c-5836-4892-8e13-e7932099c2e1 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f" status: 200 len: 354 microversion: 2.1 time: 0.054488 Sep 29 02:24:43.757212 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 536/1061] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:43 2022] GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:43.771042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7dfb2dc8-d8b7-497c-92b6-6413e7533e73 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Calling method '.version_select at 0x7f404d9ff550>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:43.837349 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7dfb2dc8-d8b7-497c-92b6-6413e7533e73 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f" status: 202 len: 0 microversion: 2.1 time: 0.070076 Sep 29 02:24:43.837922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 526/1062] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 29 02:24:43 2022] DELETE /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:24:43.846538 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-59881bd1-e2be-497c-aac0-8c2c8f8a7147 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Calling method '.version_select at 0x7f404dc1e280>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:43.895665 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-59881bd1-e2be-497c-aac0-8c2c8f8a7147 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f" status: 200 len: 353 microversion: 2.1 time: 0.053403 Sep 29 02:24:43.896391 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 537/1063] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:43 2022] GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:44.004527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:44.005164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:44.011375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:44.011836 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:44.012268 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:44.013330 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:44.013783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:44.014626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:44.263867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:44.272318 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e4720c02-bd88-4602-87c5-79f82f3a810e tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.271795 Sep 29 02:24:44.272898 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 527/1064] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:43 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:44.418573 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-b3e27e08-c204-4f19-add5-43dc3a045125 req-1c3024e9-129b-49c9-a4b2-24b8be92a7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cc41ff-33fb-4d8c-8405-fa95b5f623a7", "tag": "2f47984c-4d28-494f-9d1f-c2f51db405b8"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:44.431361 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-b3e27e08-c204-4f19-add5-43dc3a045125 req-1c3024e9-129b-49c9-a4b2-24b8be92a7e3 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:44.431851 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-b3e27e08-c204-4f19-add5-43dc3a045125 req-1c3024e9-129b-49c9-a4b2-24b8be92a7e3 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:44.432299 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-b3e27e08-c204-4f19-add5-43dc3a045125 req-1c3024e9-129b-49c9-a4b2-24b8be92a7e3 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:44.444002 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-b3e27e08-c204-4f19-add5-43dc3a045125 req-1c3024e9-129b-49c9-a4b2-24b8be92a7e3 service nova] Creating event network-changed:2f47984c-4d28-494f-9d1f-c2f51db405b8 for instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 on hv-cinder-73306 Sep 29 02:24:44.449374 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-b3e27e08-c204-4f19-add5-43dc3a045125 req-1c3024e9-129b-49c9-a4b2-24b8be92a7e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034793 Sep 29 02:24:44.450407 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 538/1065] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:44.910533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab6ecbb5-b716-42ce-a7f5-335300a441d5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Calling method '.version_select at 0x7f404dd03d30>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:44.939528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-ab6ecbb5-b716-42ce-a7f5-335300a441d5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] HTTP exception thrown: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab6ecbb5-b716-42ce-a7f5-335300a441d5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Request method failure captured: Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f HTTP/1.1 Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQHp7-cZAaIuSkolIXZzP-HFnRwOhpa30tP0cE9jHnzOs4wbfCOFyHQyesIsLhXmMIu7umNbfm3MDbSWJ54jNCcmitgaiFehGW7WfOFnRx9fW-sdjp3YLwW0Jd7qrO8EBdTEhvkObaJkxdbSzJF9_RneHIMi6XyI_Mlfsxt5J5EkOKk Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: 4aff00d4480c4797a540c1814459219e Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesGetTestJSON-1870964202 Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:24:44.941484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4aff00d4480c4797a540c1814459219e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4aff00d4480c4797a540c1814459219e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4aff00d4480c4797a540c1814459219e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4aff00d4480c4797a540c1814459219e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesGetTestJSON-1870964202 Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: 4aff00d4480c4797a540c1814459219e Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesGetTestJSON-1870964202 Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesGetTestJSON-1870964202-project Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 35e2db687fa1452289605831576cfb99 Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesGetTestJSON-1870964202-project Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': 'deb8d468-a865-400b-8e0f-5b8573fe074f'} Sep 29 02:24:44.943165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. (HTTP 404) (Request-ID: req-cb066efc-a474-42e4-9482-2b01f7a502f7) Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:44.947346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 29 02:24:44.949469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 29 02:24:44.951162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ab6ecbb5-b716-42ce-a7f5-335300a441d5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] Returning 404 to user: Volume deb8d468-a865-400b-8e0f-5b8573fe074f could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ab6ecbb5-b716-42ce-a7f5-335300a441d5 tempest-VolumesGetTestJSON-1870964202 tempest-VolumesGetTestJSON-1870964202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f" status: 404 len: 109 microversion: 2.1 time: 0.036803 Sep 29 02:24:44.952774 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 528/1066] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:44 2022] GET /compute/v2.1/os-volumes/deb8d468-a865-400b-8e0f-5b8573fe074f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 29 02:24:45.296596 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:45.297388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:45.304077 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:45.304398 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:45.304749 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:45.305458 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:45.305912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:45.306368 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:45.443591 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:45.452629 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-8e5401ba-4c99-456d-af54-379f43ae849a tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.160597 Sep 29 02:24:45.453806 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 539/1067] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:45 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:46.479043 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:46.480409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:46.491721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:46.492775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:46.494362 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:46.495324 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:46.496190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:46.496846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:46.664598 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:46.672592 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c8e6b77-75a9-452d-85e0-3259cd490085 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.199443 Sep 29 02:24:46.673270 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 529/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:46 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:47.696023 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:47.696614 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:47.703216 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:47.703678 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:47.704427 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:47.705243 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:47.705686 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:47.706125 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:47.848871 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:47.857186 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c67eae8b-1cdf-4843-ac25-d1dcfbdbefe2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.165009 Sep 29 02:24:47.857974 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 540/1069] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:47 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:47.982306 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b699c257-d834-4ef0-b5be-4aee6919b511 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404daf34c0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:48.030303 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b699c257-d834-4ef0-b5be-4aee6919b511 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3444302e-0af0-4ff5-bc43-9b5684dd24f6" status: 200 len: 350 microversion: 2.1 time: 0.051736 Sep 29 02:24:48.030965 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 530/1070] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:47 2022] GET /compute/v2.1/os-volumes/3444302e-0af0-4ff5-bc43-9b5684dd24f6 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:48.884598 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:48.885628 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:48.894910 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:48.895396 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:48.895809 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:48.896497 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:48.896969 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:48.897388 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:49.028373 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:49.037245 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-1e8dd41e-b6c6-4fa6-9ec1-e8180b253ce3 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.159129 Sep 29 02:24:49.037779 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 541/1071] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:48 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:49.410920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2fbfc8f5-b237-40aa-b54d-de69d32d2c28 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404db7b940>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:49.460525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2fbfc8f5-b237-40aa-b54d-de69d32d2c28 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/340c5afe-f561-4859-9e65-9910d8ce30cc" status: 200 len: 351 microversion: 2.1 time: 0.054040 Sep 29 02:24:49.461082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 531/1072] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:49 2022] GET /compute/v2.1/os-volumes/340c5afe-f561-4859-9e65-9910d8ce30cc => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:49.853623 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-47799d97-b8dd-4525-b2ff-baa948826305 req-c1cd9af6-eafd-4492-a870-1f0a7b081e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cc41ff-33fb-4d8c-8405-fa95b5f623a7", "name": "network-vif-plugged", "status": "completed", "tag": "2f47984c-4d28-494f-9d1f-c2f51db405b8"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:49.864278 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-47799d97-b8dd-4525-b2ff-baa948826305 req-c1cd9af6-eafd-4492-a870-1f0a7b081e8a service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:49.864762 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-47799d97-b8dd-4525-b2ff-baa948826305 req-c1cd9af6-eafd-4492-a870-1f0a7b081e8a service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:49.865892 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-47799d97-b8dd-4525-b2ff-baa948826305 req-c1cd9af6-eafd-4492-a870-1f0a7b081e8a service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:49.878346 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-47799d97-b8dd-4525-b2ff-baa948826305 req-c1cd9af6-eafd-4492-a870-1f0a7b081e8a service nova] Creating event network-vif-plugged:2f47984c-4d28-494f-9d1f-c2f51db405b8 for instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 on hv-cinder-73306 Sep 29 02:24:49.884429 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-47799d97-b8dd-4525-b2ff-baa948826305 req-c1cd9af6-eafd-4492-a870-1f0a7b081e8a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Sep 29 02:24:49.885188 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 542/1073] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:50.059518 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:50.060468 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:50.067151 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:50.067634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:50.068062 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:50.068754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:50.069237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:50.070371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:50.246617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:50.256682 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e9bb3ca3-bf64-4ce9-807f-a756784e14d5 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.201169 Sep 29 02:24:50.257242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 532/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:50 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:50.832292 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-96c81007-1e08-4804-8ab0-81895be767aa tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404dcc55e0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:50.889271 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-96c81007-1e08-4804-8ab0-81895be767aa tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/49f4e5f5-4d87-48ec-a132-76780eb39fe9" status: 200 len: 350 microversion: 2.1 time: 0.063518 Sep 29 02:24:50.889859 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 543/1075] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 29 02:24:50 2022] GET /compute/v2.1/os-volumes/49f4e5f5-4d87-48ec-a132-76780eb39fe9 => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:50.903274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2b65f4ab-1d87-4e16-afaa-a5068ad066e9 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404d9e0c10>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:50.991828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2b65f4ab-1d87-4e16-afaa-a5068ad066e9 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092517 Sep 29 02:24:50.992397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 533/1076] 10.222.0.61 () {58 vars in 1134 bytes} [Thu Sep 29 02:24:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:51.006647 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-78c0ca3e-e414-4836-9696-589174861c2b tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404dc1e280>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.095119 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-78c0ca3e-e414-4836-9696-589174861c2b tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092303 Sep 29 02:24:51.095934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 544/1077] 10.222.0.61 () {58 vars in 1149 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:51.109955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2d588f51-2523-4930-bfc9-97729c05b6db tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404d913700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.207224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2d588f51-2523-4930-bfc9-97729c05b6db tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.101100 Sep 29 02:24:51.207811 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 534/1078] 10.222.0.61 () {58 vars in 1134 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:51.221707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-421b97be-2d72-4ff7-ab14-6664357b60d8 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404d755940>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.285633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.286200 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:51.292848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:51.293336 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:51.293911 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:51.294486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:51.294975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:51.295374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:51.308994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-421b97be-2d72-4ff7-ab14-6664357b60d8 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091224 Sep 29 02:24:51.309564 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 545/1079] 10.222.0.61 () {58 vars in 1167 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:51.323385 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-90c2a836-f337-4ff5-829b-fd932eac9b98 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404dc74940>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.410463 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-90c2a836-f337-4ff5-829b-fd932eac9b98 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090780 Sep 29 02:24:51.411036 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 546/1080] 10.222.0.61 () {58 vars in 1170 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:24:51.424540 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-7bb01af5-9383-41a3-b397-de30c161d1c4 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404d9c5c10>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.434897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:51.444960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e58aaeda-431f-4f25-b377-df5155f549c2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1314 microversion: 2.1 time: 0.168585 Sep 29 02:24:51.445948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 535/1081] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:51.509866 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-7bb01af5-9383-41a3-b397-de30c161d1c4 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089045 Sep 29 02:24:51.510485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 547/1082] 10.222.0.61 () {58 vars in 1155 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:51.524738 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-563a499c-43c0-4061-9ab4-9b2770380d5d tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f4051282ca0>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.620011 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-563a499c-43c0-4061-9ab4-9b2770380d5d tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099065 Sep 29 02:24:51.620570 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 536/1083] 10.222.0.61 () {58 vars in 1188 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:24:51.635794 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-110eb848-3304-4e10-aa37-4968b2b5d778 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] Calling method '.version_select at 0x7f404dc1eca0>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:51.662656 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:51.683736 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:51.724276 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-110eb848-3304-4e10-aa37-4968b2b5d778 tempest-VolumesTestJSON-1078168734 tempest-VolumesTestJSON-1078168734-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.092674 Sep 29 02:24:51.725282 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 548/1084] 10.222.0.61 () {58 vars in 1155 bytes} [Thu Sep 29 02:24:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:52.466138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:24:52.470601 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:52.471234 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:52.478870 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:52.479366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:52.479796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:52.480479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:52.480914 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:52.481333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:52.623806 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:52.632081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7a1e950c-9d39-4348-9ba1-ff2d990cc8b9 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1498 microversion: 2.1 time: 0.166980 Sep 29 02:24:52.632636 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 537/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:52 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:53.317629 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:53.318416 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:53.325330 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:53.325886 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:53.326406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:53.327305 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:53.327777 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:53.328413 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:53.360169 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Going to try to terminate instance {{(pid=120699) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:24:53.452913 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-c5c6fa6f-a31c-49a5-b513-4120f27f835b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "DELETE /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 204 len: 0 microversion: 2.1 time: 0.139968 Sep 29 02:24:53.454088 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 549/1086] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:24:53 2022] DELETE /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:24:53.462700 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:53.463494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:53.470348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:53.471051 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:53.471267 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:53.471968 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:53.472426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:53.472847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:53.614704 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:53.623062 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b7eda343-5336-4f7e-8414-74e0560f663b tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1504 microversion: 2.1 time: 0.164377 Sep 29 02:24:53.623794 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 538/1087] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:53 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:54.649387 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:54.650165 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:54.656883 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:54.657367 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:54.657800 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:54.658529 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:54.658984 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:54.659406 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:54.797881 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:54.806541 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-922634c1-715a-4538-9352-54d9939d8791 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1504 microversion: 2.1 time: 0.161963 Sep 29 02:24:54.807084 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 550/1088] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:54 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:55.830190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:55.830810 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:55.838458 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:55.839393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:55.840136 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:55.841012 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:55.841569 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:55.842208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:55.862436 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-36d605a5-8dc1-4842-b7d9-3437f6e2bbc4 req-4e1b233d-df47-4266-84e6-078e124e8e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cc41ff-33fb-4d8c-8405-fa95b5f623a7", "name": "network-vif-deleted", "tag": "2f47984c-4d28-494f-9d1f-c2f51db405b8"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:24:55.877894 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-36d605a5-8dc1-4842-b7d9-3437f6e2bbc4 req-4e1b233d-df47-4266-84e6-078e124e8e76 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:55.878670 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-36d605a5-8dc1-4842-b7d9-3437f6e2bbc4 req-4e1b233d-df47-4266-84e6-078e124e8e76 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:55.879778 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-36d605a5-8dc1-4842-b7d9-3437f6e2bbc4 req-4e1b233d-df47-4266-84e6-078e124e8e76 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:55.892438 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-36d605a5-8dc1-4842-b7d9-3437f6e2bbc4 req-4e1b233d-df47-4266-84e6-078e124e8e76 service nova] Creating event network-vif-deleted:2f47984c-4d28-494f-9d1f-c2f51db405b8 for instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 on hv-cinder-73306 Sep 29 02:24:55.898130 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-36d605a5-8dc1-4842-b7d9-3437f6e2bbc4 req-4e1b233d-df47-4266-84e6-078e124e8e76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040641 Sep 29 02:24:55.899340 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 551/1089] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:24:55.929345 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83a16ba92834ab6a23a4b4634711178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04420159627d4beeb44bb038e633a96d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:24:55.939359 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-22f6db75-eba8-457e-9dc8-e666672641b2 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 200 len: 1462 microversion: 2.1 time: 0.113124 Sep 29 02:24:55.940317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 539/1090] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:55 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 1462 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:24:56.968887 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:24:56.969587 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] [instance: 16cc41ff-33fb-4d8c-8405-fa95b5f623a7] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:24:56.976424 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:56.976949 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:56.977392 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:56.978310 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:24:56.978599 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:24:56.979008 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:24:56.994491 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.wsgi [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] HTTP exception thrown: Instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 could not be found. Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Request method failure captured: Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: request: GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 HTTP/1.1 Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept: application/json Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Accept-Encoding: identity Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Connection: close Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Length: 0 Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Content-Type: application/json Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Host: 10.222.0.61 Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Openstack-System-Scope: None Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: User-Agent: python-urllib3/1.26.12 Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Auth-Token: gAAAAABjNQHVvjCfy8duXJbii1TgiCXR8QXVkVlAPKQkrjhhPTlvKUPxDyTBPAKO1VBMR4Q65avxF7hX33skfLCqeGJjvc7c7seR1Wvk18ON0AOvjEXcc2EUeNGUJcfWP3UYFX8ioFiLpGjImBr7OB0l6vCVp7Si3Yj-cPA5sCFeRM2IzQDWt-s Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Id: None Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Domain-Name: None Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Identity-Status: Confirmed Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Is-Admin-Project: True Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Id: default Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Domain-Name: Default Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Id: 04420159627d4beeb44bb038e633a96d Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Project-Name: tempest-VolumesActionsTest-1219425692 Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Role: member,reader Sep 29 02:24:56.996208 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Roles: member,reader Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/04420159627d4beeb44bb038e633a96d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/04420159627d4beeb44bb038e633a96d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/04420159627d4beeb44bb038e633a96d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_04420159627d4beeb44bb038e633a96d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant: tempest-VolumesActionsTest-1219425692 Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Id: 04420159627d4beeb44bb038e633a96d Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-Tenant-Name: tempest-VolumesActionsTest-1219425692 Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User: tempest-VolumesActionsTest-1219425692-project Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Id: default Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Domain-Name: Default Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Id: d83a16ba92834ab6a23a4b4634711178 Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: X-User-Name: tempest-VolumesActionsTest-1219425692-project Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: method: > Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: exception: Instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 could not be found. Sep 29 02:24:56.998095 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: action_args: {'id': '16cc41ff-33fb-4d8c-8405-fa95b5f623a7'} Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 could not be found. Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:24:56.999303 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 could not be found. Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 could not be found. Sep 29 02:24:57.000983 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: ERROR nova.api.openstack.wsgi Sep 29 02:24:57.002496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] Returning 404 to user: Instance 16cc41ff-33fb-4d8c-8405-fa95b5f623a7 could not be found. {{(pid=120699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:24:57.002496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-d4e4e4d8-af5f-4e3c-b583-5b5b53f403e6 tempest-VolumesActionsTest-1219425692 tempest-VolumesActionsTest-1219425692-project] 10.222.0.61 "GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7" status: 404 len: 111 microversion: 2.1 time: 0.033677 Sep 29 02:24:57.002496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 552/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:24:56 2022] GET /compute/v2.1/servers/16cc41ff-33fb-4d8c-8405-fa95b5f623a7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:25:40.186408 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=25 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:25:40.187874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=90 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:25:40.376323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9409518c-e7fd-4d7f-982c-bdb0a4b83b0e tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] Action: 'create', calling method: .version_select at 0x7f404d8d6700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1935867744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpSHZl9gsC57DNCAq0ZtkfuO+JZgA3i4G5HyS0rP2Fp1EITL3wOKWBUjeOB9GAE66XrJ3IfmbFwZ3pA8YWNzJWeSbCzek8KA00XKNAxGEjzQRZPEjIclXhr9201qljKiQ=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:25:40.392493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-9409518c-e7fd-4d7f-982c-bdb0a4b83b0e tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] Getting quotas for project a2f2d778c35d4a90a28aeef64fefa8fb. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:25:40.396278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-9409518c-e7fd-4d7f-982c-bdb0a4b83b0e tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] Getting quotas for user 6ce84f7e891242c393d0ac5e97c8a9e2 and project a2f2d778c35d4a90a28aeef64fefa8fb. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:25:40.419633 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9409518c-e7fd-4d7f-982c-bdb0a4b83b0e tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.238960 Sep 29 02:25:40.420115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 540/1092] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:25:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:26:02.709319 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:02.710231 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:02.715758 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-207273800", "imageRef": "b3d05bdb-a9a2-46e0-af1b-a887f7a873a9", "flavorRef": "452"}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:02.774426 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] validate_networks() for None {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:26:03.310576 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Flavor limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:26:03.310994 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Image limits 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:26:03.311464 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Flavor pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:26:03.311870 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Image pref 0:0:0 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:26:03.312256 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.virt.hardware [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120699) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:26:03.321305 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:03.321721 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:03.322193 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:03.322912 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:03.323365 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:03.323764 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:03.340791 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Getting quotas for project dc905e15987d46eea284f353199a068a. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:26:03.345158 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.quota [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Getting quotas for user 2878911f759e4395a0381a6eb28ad8f5 and project dc905e15987d46eea284f353199a068a. Resources: {'instances', 'cores', 'ram'} {{(pid=120699) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:26:03.357272 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Going to run 1 instances... {{(pid=120699) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:26:03.359617 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3d05bdb-a9a2-46e0-af1b-a887f7a873a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120699) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:26:03.408148 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-44ecd33b-482a-4401-8fed-78cbbbf207f5 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700857 Sep 29 02:26:03.408934 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 553/1093] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:26:03.418206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:03.418955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:03.422899 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dbaa8a8a-8ddb-487c-8bc7-54fc3c557311 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:03.423517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dbaa8a8a-8ddb-487c-8bc7-54fc3c557311 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:03.484865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dbaa8a8a-8ddb-487c-8bc7-54fc3c557311 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:03.491938 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dbaa8a8a-8ddb-487c-8bc7-54fc3c557311 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1214 microversion: 2.1 time: 0.075157 Sep 29 02:26:03.493196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 541/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:03 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:04.515520 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:04.516133 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.compute.api [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120699) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:04.524057 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:04.524546 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:04.524979 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:04.525682 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:04.526168 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:04.526636 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:04.600971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.policy [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120699) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:04.611108 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [None req-e848813e-5704-4a2d-bcc4-ba0979c5c605 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1274 microversion: 2.1 time: 0.099442 Sep 29 02:26:04.611965 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 554/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:04 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:05.635355 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:05.635962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:05.643319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:05.644055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:05.644479 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:05.645343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:05.645790 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:05.646227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:05.883677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:05.891863 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f35723d1-cc7d-439e-b509-246ab372338d tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.260486 Sep 29 02:26:05.892440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 542/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:05 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:06.594228 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [req-3d17bff6-202e-4569-a5f1-2b70d03b1d2c req-21479b6f-f4d6-4fef-9ece-445204b0f508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8", "tag": "6d1f4185-ffb1-4b75-bd83-60d01eef0335"}]} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:06.604732 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3d17bff6-202e-4569-a5f1-2b70d03b1d2c req-21479b6f-f4d6-4fef-9ece-445204b0f508 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:06.605207 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3d17bff6-202e-4569-a5f1-2b70d03b1d2c req-21479b6f-f4d6-4fef-9ece-445204b0f508 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:06.605627 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG oslo_concurrency.lockutils [req-3d17bff6-202e-4569-a5f1-2b70d03b1d2c req-21479b6f-f4d6-4fef-9ece-445204b0f508 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:06.620496 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.compute.server_external_events [req-3d17bff6-202e-4569-a5f1-2b70d03b1d2c req-21479b6f-f4d6-4fef-9ece-445204b0f508 service nova] Creating event network-changed:6d1f4185-ffb1-4b75-bd83-60d01eef0335 for instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 on hv-cinder-73306 Sep 29 02:26:06.626091 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO nova.api.openstack.requestlog [req-3d17bff6-202e-4569-a5f1-2b70d03b1d2c req-21479b6f-f4d6-4fef-9ece-445204b0f508 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035532 Sep 29 02:26:06.626920 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: [pid: 120699|app: 0|req: 555/1097] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:26:06.915045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:06.915642 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:06.922246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:06.922729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:06.923155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:06.923847 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:06.924293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:06.924710 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:07.116860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:07.125236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8ee53e35-98e3-4a33-b0e2-3294ebb7e488 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.214343 Sep 29 02:26:07.125813 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 543/1098] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:06 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:07.330180 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.api.openstack.wsgi [None req-dcd8b4ff-9f2d-4c72-bcbf-eec7461a5d5f tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1505168020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1935867744", "security_groups": [{"name": "tempest-secgroup-smoke-1376723510"}], "networks": [{"uuid": "28b8264b-f182-4854-bb09-b0fa97f8ddc5"}], "block_device_mapping_v2": [{"uuid": "f5370616-be4c-44c2-98ed-6196acd02114", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:07.449945 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG nova.network.neutron [None req-dcd8b4ff-9f2d-4c72-bcbf-eec7461a5d5f tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] validate_networks() for [('28b8264b-f182-4854-bb09-b0fa97f8ddc5', None, None, None, None, None)] {{(pid=120699) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:26:08.152719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:08.153675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:08.163856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:08.164343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:08.164785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:08.165485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:08.165946 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:08.166397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:08.303826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:08.312226 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3000e6e-e56e-437d-a1b2-cea3033e1036 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.166428 Sep 29 02:26:08.312768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 544/1099] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:08 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:09.338634 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:09.339348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:09.346080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:09.346602 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:09.347002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:09.347701 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:09.348151 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:09.348570 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:09.530111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:09.540574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5be8a5e3-8830-4282-b487-ab36bef1b870 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.206253 Sep 29 02:26:09.541145 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 545/1100] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:09 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:10.564667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:10.565304 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:10.572467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:10.572956 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:10.573391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:10.574115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:10.574563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:10.575002 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:10.713207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:10.721249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-dd6de26c-0bd5-4648-a30a-ac5600307ec1 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.160724 Sep 29 02:26:10.721840 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 546/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:10 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:11.744597 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:11.745255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:11.751659 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:11.752141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:11.752565 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:11.753272 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:11.753717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:11.754182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:11.897467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:11.905615 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-32311f18-08e5-4a2f-806d-fce087470e5f tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.165519 Sep 29 02:26:11.906211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 547/1102] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:11 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:12.157826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-0e18740a-4d77-4d07-a5ba-4915913bae2d req-0e398ae6-6789-43be-80f6-6e06b5d36aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8", "name": "network-vif-plugged", "status": "completed", "tag": "6d1f4185-ffb1-4b75-bd83-60d01eef0335"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:12.170087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0e18740a-4d77-4d07-a5ba-4915913bae2d req-0e398ae6-6789-43be-80f6-6e06b5d36aca service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:12.170957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0e18740a-4d77-4d07-a5ba-4915913bae2d req-0e398ae6-6789-43be-80f6-6e06b5d36aca service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:12.171395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-0e18740a-4d77-4d07-a5ba-4915913bae2d req-0e398ae6-6789-43be-80f6-6e06b5d36aca service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:12.183065 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-0e18740a-4d77-4d07-a5ba-4915913bae2d req-0e398ae6-6789-43be-80f6-6e06b5d36aca service nova] Creating event network-vif-plugged:6d1f4185-ffb1-4b75-bd83-60d01eef0335 for instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 on hv-cinder-73306 Sep 29 02:26:12.188507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-0e18740a-4d77-4d07-a5ba-4915913bae2d req-0e398ae6-6789-43be-80f6-6e06b5d36aca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Sep 29 02:26:12.189172 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 548/1103] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:26:12.934361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:12.935472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:12.945740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:12.946191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:12.946619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:12.947306 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:12.947753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:12.948178 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:13.083675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:13.092630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3475b41a-b58b-4bf1-94ca-3cc33c866429 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1314 microversion: 2.1 time: 0.165463 Sep 29 02:26:13.093198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 549/1104] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:12 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:13.332290 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=2 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:13.352566 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell0:SELECT=6 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:14.119971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:14.120679 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:14.123038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:14.130038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:14.130600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:14.131112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:14.131937 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:14.132465 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:14.133360 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:14.265810 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:14.274023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-be5e01ff-2bed-4255-adc2-0a9bd048fcd7 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1464 microversion: 2.1 time: 0.160403 Sep 29 02:26:14.274595 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 550/1105] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:14 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:14.326647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:14.327383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:14.336547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:14.337292 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:14.338089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:14.339086 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:14.339711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:14.340307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:14.369547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:26:14.453578 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-18b3d41d-166c-46c5-a1aa-2efd830af904 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 204 len: 0 microversion: 2.1 time: 0.131786 Sep 29 02:26:14.454185 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 551/1106] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:26:14 2022] DELETE /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:26:14.463614 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:14.464315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:14.470341 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:14.470827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:14.471255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:14.471935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:14.472381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:14.472797 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:14.610070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:14.621993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-63a5e857-8ddd-4b32-a5bc-bd4f13a3a19c tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1470 microversion: 2.1 time: 0.162566 Sep 29 02:26:14.622816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 552/1107] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:14 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:26:15.649510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:15.650205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:15.656814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:15.657294 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:15.657717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:15.658431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:15.658887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:15.659292 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:15.796295 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:15.808537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e0ba6916-d7cb-470a-bb4b-66b6c3b4ff78 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1470 microversion: 2.1 time: 0.163171 Sep 29 02:26:15.809320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 553/1108] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:15 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:16.525352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-617e6026-5024-4f94-95f6-3c9a70e3d8c3 req-ee560111-99ec-43aa-b718-95f4c1dc255d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8", "name": "network-vif-deleted", "tag": "6d1f4185-ffb1-4b75-bd83-60d01eef0335"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:16.537439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-617e6026-5024-4f94-95f6-3c9a70e3d8c3 req-ee560111-99ec-43aa-b718-95f4c1dc255d service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:16.538338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-617e6026-5024-4f94-95f6-3c9a70e3d8c3 req-ee560111-99ec-43aa-b718-95f4c1dc255d service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:16.538518 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-617e6026-5024-4f94-95f6-3c9a70e3d8c3 req-ee560111-99ec-43aa-b718-95f4c1dc255d service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:16.551922 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-617e6026-5024-4f94-95f6-3c9a70e3d8c3 req-ee560111-99ec-43aa-b718-95f4c1dc255d service nova] Creating event network-vif-deleted:6d1f4185-ffb1-4b75-bd83-60d01eef0335 for instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 on hv-cinder-73306 Sep 29 02:26:16.557110 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-617e6026-5024-4f94-95f6-3c9a70e3d8c3 req-ee560111-99ec-43aa-b718-95f4c1dc255d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036570 Sep 29 02:26:16.558111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 554/1109] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:26:16.610397 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_cell1:SELECT=10 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:16.841993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:16.843139 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:16.852784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:16.853270 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:16.853727 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:16.854431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:16.854886 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:16.855315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:16.887070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:16.887548 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:16.887979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:16.888424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lazy-loading 'fault' on Instance uuid 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:26:16.933026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2878911f759e4395a0381a6eb28ad8f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc905e15987d46eea284f353199a068a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:16.945211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c2a7948f-34ec-4338-88f2-a14b8fd6a369 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 200 len: 1304 microversion: 2.1 time: 0.111407 Sep 29 02:26:16.946121 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 555/1110] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:16 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:17.343004 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: DEBUG dbcounter [-] [120699] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=120699) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:17.978500 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:17.979450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] [instance: 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:17.991240 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:17.991734 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:17.992187 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:17.992868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:17.993321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:17.993745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:18.008290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] HTTP exception thrown: Instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 could not be found. Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Request method failure captured: Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 HTTP/1.1 Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQI4ILFCXj8Q5CTJgsst9gb8Tw46Ms1XeLUEXoDk7t-co-XOs84J8Zl6DaLjk9cMC7SRRWWOwbuZJVNaSO4clUTWCr8HeZUj-TYYwW6YKsDIQ90YSQIbVtUPhiDWB-VqbbZuL_bblKZOoglG0_oyHpb7mp0caSZk7xScWal1tjuDkug Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: dc905e15987d46eea284f353199a068a Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-VolumesNegativeTest-1147511730 Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:26:18.009961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dc905e15987d46eea284f353199a068a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc905e15987d46eea284f353199a068a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dc905e15987d46eea284f353199a068a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dc905e15987d46eea284f353199a068a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-VolumesNegativeTest-1147511730 Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: dc905e15987d46eea284f353199a068a Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-VolumesNegativeTest-1147511730 Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-VolumesNegativeTest-1147511730-project Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: 2878911f759e4395a0381a6eb28ad8f5 Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-VolumesNegativeTest-1147511730-project Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 could not be found. Sep 29 02:26:18.011712 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8'} Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 could not be found. Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:26:18.012713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 could not be found. Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 could not be found. Sep 29 02:26:18.014320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:26:18.015702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] Returning 404 to user: Instance 3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:26:18.015702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6c87c81-22fa-403f-b49e-cd7bcab804f6 tempest-VolumesNegativeTest-1147511730 tempest-VolumesNegativeTest-1147511730-project] 10.222.0.61 "GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8" status: 404 len: 111 microversion: 2.1 time: 0.040172 Sep 29 02:26:18.015702 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 556/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:17 2022] GET /compute/v2.1/servers/3ea9287d-2bc1-4dbd-8f2b-b9eec1ec39e8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:26:32.925266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:32.927209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:33.091574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-24b2431f-baab-45d1-83bf-389e855c6cae tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Action: 'create', calling method: .version_select at 0x7f404dad0280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1964195389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjA0pCDx/Y1mmKtP7sGopA5zsaNCYYeZ/59+DuSvwwyCjsxXi05qtYdLZWXNa8vCiGQ4N9i/BDC1NFZTaJC175JcP+a3kCEaFRVsAV260TLbucHgsdWg/NIGN5muhQEaA=="}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:33.107920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-24b2431f-baab-45d1-83bf-389e855c6cae tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for project e57890af7876437d9fddfea4a536a0d7. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:26:33.112788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-24b2431f-baab-45d1-83bf-389e855c6cae tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for user bbb9be467f4947f4a203a3de6c37fa9a and project e57890af7876437d9fddfea4a536a0d7. Resources: {'key_pairs'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:26:33.139278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-24b2431f-baab-45d1-83bf-389e855c6cae tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.219449 Sep 29 02:26:33.139884 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 557/1112] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 29 02:26:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:26:54.868670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=4 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:54.869422 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:26:54.873350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1917299055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1964195389", "security_groups": [{"name": "tempest-secgroup-smoke-1913896121"}], "block_device_mapping_v2": [{"uuid": "8c2cb69a-1918-44f4-9b58-7b0a27a4e7fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "97027d5c-275b-43e9-ab3b-3dc0aafb8749"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:26:54.999137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] validate_networks() for [('97027d5c-275b-43e9-ab3b-3dc0aafb8749', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:26:55.391542 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:26:55.392208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:26:55.392979 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:26:55.393631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:26:55.394394 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:26:55.405524 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:55.406026 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:55.406476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:55.407211 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:26:55.407665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:26:55.408088 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:26:55.426520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for project e57890af7876437d9fddfea4a536a0d7. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:26:55.432684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for user bbb9be467f4947f4a203a3de6c37fa9a and project e57890af7876437d9fddfea4a536a0d7. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:26:55.502286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:26:55.504442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c2cb69a-1918-44f4-9b58-7b0a27a4e7fa',volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:26:55.645799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [24abe304-8763-4dd5-b240-1d7525ed1ce5] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 29 02:26:56.658361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [24abe304-8763-4dd5-b240-1d7525ed1ce5] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 53914. Sep 29 02:26:56.665454 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ea1b603b-8c6c-4a5a-9650-2ce0c3bbda13 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.797766 Sep 29 02:26:56.666130 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 558/1113] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:26:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 29 02:26:56.677441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4b53bf59-d6dc-4a5a-85ce-e36aaadaa59d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:56.678044 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4b53bf59-d6dc-4a5a-85ce-e36aaadaa59d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:56.734402 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4b53bf59-d6dc-4a5a-85ce-e36aaadaa59d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:56.741320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4b53bf59-d6dc-4a5a-85ce-e36aaadaa59d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1095 microversion: 2.1 time: 0.067665 Sep 29 02:26:56.741877 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 559/1114] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:56 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:57.768391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b6a61e52-5e2f-49ae-8c3a-b89f57b950e5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:57.769397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b6a61e52-5e2f-49ae-8c3a-b89f57b950e5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:57.829405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b6a61e52-5e2f-49ae-8c3a-b89f57b950e5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:57.839108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b6a61e52-5e2f-49ae-8c3a-b89f57b950e5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1095 microversion: 2.1 time: 0.078327 Sep 29 02:26:57.839645 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 560/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:57 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:58.862757 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-196b38f0-68de-47fa-a5f0-442710927d11 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:58.863475 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-196b38f0-68de-47fa-a5f0-442710927d11 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:26:58.919293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-196b38f0-68de-47fa-a5f0-442710927d11 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:26:58.926959 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-196b38f0-68de-47fa-a5f0-442710927d11 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1095 microversion: 2.1 time: 0.068006 Sep 29 02:26:58.927600 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 561/1116] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:58 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:26:59.955537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9386f337-b4bb-4909-8550-834c9857fe1d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:26:59.956677 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9386f337-b4bb-4909-8550-834c9857fe1d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:00.012843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9386f337-b4bb-4909-8550-834c9857fe1d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:00.019740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9386f337-b4bb-4909-8550-834c9857fe1d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1095 microversion: 2.1 time: 0.071442 Sep 29 02:27:00.020440 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 562/1117] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:26:59 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:27:01.047561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:01.048663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:01.059667 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:01.060441 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:01.061142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:01.062373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:01.063142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:01.063856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:01.126892 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:01.134976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80a548aa-60e3-4829-b5e1-0b9355b54c77 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1145 microversion: 2.1 time: 0.093947 Sep 29 02:27:01.135540 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 563/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:01 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:02.157269 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:02.157915 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:02.164713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:02.165376 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:02.165618 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:02.166276 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:02.166761 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:02.167180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:02.259729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:02.267930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-81780561-bb92-403d-9b83-ba7422b93db5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1211 microversion: 2.1 time: 0.114852 Sep 29 02:27:02.268496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 564/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:02 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1211 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:03.284854 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-56a6bb47-5037-460c-8bb2-7e4a6f5a68e6 req-d9b829a3-add1-4d6d-b7d7-c19ed568df86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f616df-79c4-478c-a52c-a9f9329912f6", "tag": "d54b1ea7-d378-4072-87bb-af28e3a4e7b5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:27:03.300258 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56a6bb47-5037-460c-8bb2-7e4a6f5a68e6 req-d9b829a3-add1-4d6d-b7d7-c19ed568df86 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:03.301171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56a6bb47-5037-460c-8bb2-7e4a6f5a68e6 req-d9b829a3-add1-4d6d-b7d7-c19ed568df86 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:03.301358 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-56a6bb47-5037-460c-8bb2-7e4a6f5a68e6 req-d9b829a3-add1-4d6d-b7d7-c19ed568df86 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:03.315287 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-56a6bb47-5037-460c-8bb2-7e4a6f5a68e6 req-d9b829a3-add1-4d6d-b7d7-c19ed568df86 service nova] Creating event network-changed:d54b1ea7-d378-4072-87bb-af28e3a4e7b5 for instance 80f616df-79c4-478c-a52c-a9f9329912f6 on hv-cinder-73306 Sep 29 02:27:03.322807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-56a6bb47-5037-460c-8bb2-7e4a6f5a68e6 req-d9b829a3-add1-4d6d-b7d7-c19ed568df86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042640 Sep 29 02:27:03.323641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 565/1120] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:27:03.328895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:03.329582 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:03.337493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:03.337976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:03.338452 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:03.339146 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:03.339590 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:03.340003 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:03.537865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:03.546812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-616229b5-7de1-48af-b9a6-4547d2408000 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.221766 Sep 29 02:27:03.547848 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 566/1121] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:03 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:04.569233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:04.569861 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:04.576373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:04.576829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:04.577257 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:04.577942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:04.578425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:04.578843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:04.759170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:04.767539 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-442a50be-728b-43fa-a5b9-2f7b10498f0a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.202304 Sep 29 02:27:04.768108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 567/1122] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:04 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:05.794477 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:05.795392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:05.797828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:05.806576 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:05.807252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:05.807865 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:05.808833 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:05.809514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:05.810144 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:05.955273 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:05.967958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-86d094e9-b539-4882-aa05-5301ea2f9adf tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.179318 Sep 29 02:27:05.968780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 568/1123] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:05 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:06.998079 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:06.999170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:07.010027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:07.010846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:07.011559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:07.012737 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:07.013534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:07.014285 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:07.151469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:07.159574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ff379e46-a461-4441-945c-4ef893ca0ec6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.168100 Sep 29 02:27:07.160139 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 569/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:06 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:07.569155 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b2ac848f-4f65-41de-b1c1-5e5534453240 tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] Calling method '.version_select at 0x7f404d913790>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:07.595214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b2ac848f-4f65-41de-b1c1-5e5534453240 tempest-TestShelveInstance-640345637 tempest-TestShelveInstance-640345637-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1935867744" status: 202 len: 0 microversion: 2.1 time: 0.029974 Sep 29 02:27:07.596000 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 570/1125] 10.222.0.61 () {58 vars in 1254 bytes} [Thu Sep 29 02:27:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1935867744 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 29 02:27:08.183247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:08.183891 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:08.190152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:08.190637 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:08.191071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:08.191768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:08.192221 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:08.192678 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:08.332092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:08.340713 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-394c1986-dc55-49c1-925e-b6e8be50a352 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.162104 Sep 29 02:27:08.341259 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 571/1126] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:08 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:09.365233 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:09.366517 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:09.373602 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:09.374115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:09.374887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:09.375924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:09.376708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:09.377152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:09.543970 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:09.552067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bb0f027c-b56e-4915-ab01-baaeaab86cfe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.191277 Sep 29 02:27:09.567103 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 572/1127] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:09 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:10.575419 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:10.576183 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:10.578387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:10.585319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:10.585987 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:10.586707 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:10.587818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:10.588493 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:10.589133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:10.849525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:10.859611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ae0116ae-65b9-4822-bc37-2cd03c60a0dc tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.287174 Sep 29 02:27:10.859611 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 573/1128] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:10 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:27:11.882555 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:11.883237 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:11.889960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:11.890496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:11.890932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:11.891630 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:11.892078 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:11.892472 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:12.113648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:12.122463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d8b44f0c-fa7e-4cb6-8038-4b27b5752681 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.243977 Sep 29 02:27:12.123405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 574/1129] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:11 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:13.147887 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:13.148579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:13.156768 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:13.157658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:13.158115 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:13.158996 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:13.159605 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:13.160230 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:13.304612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:13.312921 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d7f4a46e-0475-4b3a-9210-5fd40d1b0103 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.170874 Sep 29 02:27:13.313498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 575/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:13 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:27:14.338429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:14.339824 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:14.346919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:14.347608 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:14.348244 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:14.349928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:14.350554 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:14.351148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:14.489480 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:14.497762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d872d83f-4c6e-4c70-aa26-8632be0a1ab5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.164449 Sep 29 02:27:14.500322 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 576/1131] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:14 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:15.524974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:15.525827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:15.534745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:15.535717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:15.536520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:15.537159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:15.537717 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:15.538508 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:15.677560 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:15.685621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f665d4f6-1619-4bbc-b87c-0e22f320e8d0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.165977 Sep 29 02:27:15.686264 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 577/1132] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:15 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:16.449900 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-8fbb5fe8-a60f-4871-a2a8-2503f805303e req-e4fd5664-62a9-426f-a18a-1cf596ab8776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f616df-79c4-478c-a52c-a9f9329912f6", "name": "network-vif-plugged", "status": "completed", "tag": "d54b1ea7-d378-4072-87bb-af28e3a4e7b5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:27:16.460134 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8fbb5fe8-a60f-4871-a2a8-2503f805303e req-e4fd5664-62a9-426f-a18a-1cf596ab8776 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:16.460754 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8fbb5fe8-a60f-4871-a2a8-2503f805303e req-e4fd5664-62a9-426f-a18a-1cf596ab8776 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:16.461490 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-8fbb5fe8-a60f-4871-a2a8-2503f805303e req-e4fd5664-62a9-426f-a18a-1cf596ab8776 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:16.472807 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-8fbb5fe8-a60f-4871-a2a8-2503f805303e req-e4fd5664-62a9-426f-a18a-1cf596ab8776 service nova] Creating event network-vif-plugged:d54b1ea7-d378-4072-87bb-af28e3a4e7b5 for instance 80f616df-79c4-478c-a52c-a9f9329912f6 on hv-cinder-73306 Sep 29 02:27:16.478559 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-8fbb5fe8-a60f-4871-a2a8-2503f805303e req-e4fd5664-62a9-426f-a18a-1cf596ab8776 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032298 Sep 29 02:27:16.479242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 578/1133] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:27:16.710719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:16.711439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:16.718037 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:16.718530 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:16.718964 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:16.719660 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:16.720105 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:16.720490 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:16.889092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:16.898975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-37d53910-f094-4b59-aa10-8d3ff77c1c20 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.193317 Sep 29 02:27:16.899544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 579/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:16 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:17.934797 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:17.935924 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:17.945367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:17.945846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:17.946301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:17.946989 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:17.947431 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:17.947876 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:18.083568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:18.091397 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4150db86-9c88-4db8-bf52-b24d77a34182 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1267 microversion: 2.1 time: 0.163259 Sep 29 02:27:18.091980 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 580/1135] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:17 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:19.118425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:19.119521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:19.130520 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:19.131332 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:19.132064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:19.133205 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:19.133964 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:19.134722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:19.157222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:27:19.280665 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:19.289166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-80d5f739-ab89-479f-b325-1b79b77f5144 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1454 microversion: 2.1 time: 0.177602 Sep 29 02:27:19.289711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 581/1136] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:19 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:19.311220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:27:19.311858 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:27:19.318208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:19.318699 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:19.319137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:19.319860 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:19.320311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:19.320735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:19.451912 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:27:19.460507 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b9860ab6-fea8-4b11-88db-aecc73d52579 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1454 microversion: 2.1 time: 0.152830 Sep 29 02:27:19.461047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 582/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:27:19 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:27:21.436962 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cbf2671a-67a5-4c54-9b0d-d226649ed308 req-e115fab4-e05d-4146-89bd-e3aa5795c7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f616df-79c4-478c-a52c-a9f9329912f6", "tag": "d54b1ea7-d378-4072-87bb-af28e3a4e7b5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:27:21.446529 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cbf2671a-67a5-4c54-9b0d-d226649ed308 req-e115fab4-e05d-4146-89bd-e3aa5795c7de service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:27:21.447006 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cbf2671a-67a5-4c54-9b0d-d226649ed308 req-e115fab4-e05d-4146-89bd-e3aa5795c7de service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:27:21.447424 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cbf2671a-67a5-4c54-9b0d-d226649ed308 req-e115fab4-e05d-4146-89bd-e3aa5795c7de service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:27:21.458688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cbf2671a-67a5-4c54-9b0d-d226649ed308 req-e115fab4-e05d-4146-89bd-e3aa5795c7de service nova] Creating event network-changed:d54b1ea7-d378-4072-87bb-af28e3a4e7b5 for instance 80f616df-79c4-478c-a52c-a9f9329912f6 on hv-cinder-73306 Sep 29 02:27:21.463784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cbf2671a-67a5-4c54-9b0d-d226649ed308 req-e115fab4-e05d-4146-89bd-e3aa5795c7de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161865 Sep 29 02:27:21.464377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 583/1138] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:29:22.728282 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:29:22.729239 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:29:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:29:22.731078 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:29:22.731332 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:29:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:29:29.593971 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:29:29.594624 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:29:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:29:35.752557 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113d2e06-c93f-4a23-8b52-ef81092d5b28] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 29 02:29:35.753169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:35.753948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:35.755109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 29 02:29:35.756932 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 29 02:29:35.763266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:35.763837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:35.772951 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:35.773426 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:35.773873 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:35.774574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:35.775017 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:35.775438 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:35.801160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:29:35.881343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b0c84fa0-03bd-4f72-a829-36e0b06926d9 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "DELETE /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 204 len: 0 microversion: 2.1 time: 0.131543 Sep 29 02:29:35.881926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 584/1139] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:29:35 2022] DELETE /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:29:35.890265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:35.890948 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:35.896827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:35.897335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:35.897799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:35.898443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:35.898886 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:35.899317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:36.090455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:36.098977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-257a0dc4-ec62-4627-a14c-7962dadcea27 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1579 microversion: 2.1 time: 0.212759 Sep 29 02:29:36.099545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 585/1140] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:35 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1579 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:29:37.126579 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:37.127399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:37.140068 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:37.140602 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:37.141082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:37.141867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:37.142488 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:37.142988 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:37.147024 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [113d2e06-c93f-4a23-8b52-ef81092d5b28] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 54082. Sep 29 02:29:37.279270 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:37.287490 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-05d40733-e0cc-4946-b84e-f5cce32ec6aa tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1579 microversion: 2.1 time: 0.167447 Sep 29 02:29:37.288059 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 586/1141] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:37 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:38.311274 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:38.311983 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:38.319629 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:38.320112 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:38.320563 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:38.321252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:38.321661 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:38.322129 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:38.550338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:38.558339 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6af38bbe-9c2c-4ea1-8bb4-6bd3462feff3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1579 microversion: 2.1 time: 0.251295 Sep 29 02:29:38.558910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 587/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:38 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1579 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:39.012631 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-fba67531-ea28-491c-942b-28161074136a req-6eb2bb0e-3f59-40ef-a556-976e598cc0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f616df-79c4-478c-a52c-a9f9329912f6", "name": "network-vif-deleted", "tag": "d54b1ea7-d378-4072-87bb-af28e3a4e7b5"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:29:39.025788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fba67531-ea28-491c-942b-28161074136a req-6eb2bb0e-3f59-40ef-a556-976e598cc0b7 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:39.026301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fba67531-ea28-491c-942b-28161074136a req-6eb2bb0e-3f59-40ef-a556-976e598cc0b7 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:39.026753 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-fba67531-ea28-491c-942b-28161074136a req-6eb2bb0e-3f59-40ef-a556-976e598cc0b7 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:39.040326 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-fba67531-ea28-491c-942b-28161074136a req-6eb2bb0e-3f59-40ef-a556-976e598cc0b7 service nova] Creating event network-vif-deleted:d54b1ea7-d378-4072-87bb-af28e3a4e7b5 for instance 80f616df-79c4-478c-a52c-a9f9329912f6 on hv-cinder-73306 Sep 29 02:29:39.046309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-fba67531-ea28-491c-942b-28161074136a req-6eb2bb0e-3f59-40ef-a556-976e598cc0b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105349 Sep 29 02:29:39.047222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 588/1143] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:29:39.584834 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:39.585534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:39.592293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:39.592818 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:39.593251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:39.593966 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:39.594446 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:39.594868 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:39.629428 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:39.629883 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:39.630375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:39.630827 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lazy-loading 'fault' on Instance uuid 80f616df-79c4-478c-a52c-a9f9329912f6 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:29:39.678392 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:39.689755 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eef52e1b-fe43-415a-9251-7ed6e6b86360 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 200 len: 1231 microversion: 2.1 time: 0.109663 Sep 29 02:29:39.690353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 589/1144] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:39 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:40.717199 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:40.718255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:40.728460 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:40.729199 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:40.729854 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:40.730963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:40.731651 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:40.732323 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:40.747451 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] HTTP exception thrown: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Request method failure captured: Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 HTTP/1.1 Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQJTmhowkilXKKT1h1wRDI-siDUXd2NIpVS-IZE_MQWdMa3s7_ar2L6exoIo6PQ_bA5NhE8sv28KwkvNqPBAgGuVScHY5qYxPn8sPjayBYdTOswh1ow0Kn25stwXhwRGvK00K6q8cYvbAGcU-NGZ4v-x_14-noqRpHt3Tfa3bH0MCRU Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:29:40.749101 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: bbb9be467f4947f4a203a3de6c37fa9a Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:29:40.750994 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '80f616df-79c4-478c-a52c-a9f9329912f6'} Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:29:40.752161 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:29:40.754019 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:29:40.755664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Returning 404 to user: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:29:40.755664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b397b785-29af-44bf-83f3-90ec31e78250 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 404 len: 111 microversion: 2.1 time: 0.039324 Sep 29 02:29:40.755664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 590/1145] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:40 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 29 02:29:40.847164 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1478754486", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1964195389", "security_groups": [{"name": "tempest-secgroup-smoke-1913896121"}], "block_device_mapping_v2": [{"uuid": "8c2cb69a-1918-44f4-9b58-7b0a27a4e7fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "97027d5c-275b-43e9-ab3b-3dc0aafb8749"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:29:40.966538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] validate_networks() for [('97027d5c-275b-43e9-ab3b-3dc0aafb8749', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:29:41.416663 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:29:41.417056 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:29:41.417526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:29:41.417928 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:29:41.418370 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:29:41.428279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:41.428823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:41.429255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:41.429974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:41.430455 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:41.430874 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:41.447308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for project e57890af7876437d9fddfea4a536a0d7. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:29:41.451521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for user bbb9be467f4947f4a203a3de6c37fa9a and project e57890af7876437d9fddfea4a536a0d7. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:29:41.517943 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:29:41.520194 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c2cb69a-1918-44f4-9b58-7b0a27a4e7fa',volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:29:41.662223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2483c21c-bbcc-4d80-b37e-5b4a800a90b0 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818931 Sep 29 02:29:41.662766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 591/1146] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:29:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 29 02:29:41.673907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-50b81572-2d6d-4d27-924c-9f79ec957908 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:41.674551 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-50b81572-2d6d-4d27-924c-9f79ec957908 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:41.728987 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-50b81572-2d6d-4d27-924c-9f79ec957908 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:41.737486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-50b81572-2d6d-4d27-924c-9f79ec957908 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1095 microversion: 2.1 time: 0.067348 Sep 29 02:29:41.738535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 592/1147] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:41 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:29:42.762653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:42.763328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:42.772171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:42.772643 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:42.773108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:42.773812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:42.774300 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:42.774711 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:42.849843 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:42.859574 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d85297ef-207f-4846-8a6c-971e5333e16b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1193 microversion: 2.1 time: 0.102487 Sep 29 02:29:42.861111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 593/1148] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:42 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:43.885935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:43.886635 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:43.893020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:43.893496 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:43.893926 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:43.894651 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:43.895104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:43.895526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:44.099464 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:44.107564 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a8b1dcbb-fe64-49bb-b745-ec79c307051a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.225707 Sep 29 02:29:44.108173 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 594/1149] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:43 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:29:44.390309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-81895446-e650-4e67-bf46-23042540ef9e req-dded60e1-c460-4857-ad8f-7525be085855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b947685a-7d2f-4d2f-a45a-5a6a50d5fa69", "tag": "5c881b0f-39f9-45eb-a932-00ea21c3b8fa"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:29:44.401499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81895446-e650-4e67-bf46-23042540ef9e req-dded60e1-c460-4857-ad8f-7525be085855 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:44.402222 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81895446-e650-4e67-bf46-23042540ef9e req-dded60e1-c460-4857-ad8f-7525be085855 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:44.403042 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-81895446-e650-4e67-bf46-23042540ef9e req-dded60e1-c460-4857-ad8f-7525be085855 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:44.414018 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-81895446-e650-4e67-bf46-23042540ef9e req-dded60e1-c460-4857-ad8f-7525be085855 service nova] Creating event network-changed:5c881b0f-39f9-45eb-a932-00ea21c3b8fa for instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 on hv-cinder-73306 Sep 29 02:29:44.419039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-81895446-e650-4e67-bf46-23042540ef9e req-dded60e1-c460-4857-ad8f-7525be085855 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032612 Sep 29 02:29:44.419638 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 595/1150] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:29:45.137007 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:45.138281 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:45.146775 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:45.147255 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:45.147683 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:45.148371 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:45.148822 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:45.149247 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:45.299470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:45.310729 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6e1c443a-7a8a-4a29-8a23-550c448d3cf6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.181295 Sep 29 02:29:45.311528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 596/1151] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:45 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:46.339160 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:46.340229 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:46.349550 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:46.350032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:46.350498 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:46.351190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:46.351639 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:46.352057 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:46.485476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:46.493491 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-a98512a5-a5c9-41c6-bf3d-91d7ad7ad43d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.160909 Sep 29 02:29:46.494081 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 597/1152] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:46 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:47.520265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:47.521133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:47.529791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:47.530425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:47.530960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:47.531812 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:47.532372 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:47.532897 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:47.666904 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:47.675277 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1007cf18-8d86-49bb-9095-90aa1ab0885f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.161064 Sep 29 02:29:47.675853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 598/1153] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:47 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:48.700223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:48.701066 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:48.708684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:48.709162 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:48.709617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:48.710393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:48.710837 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:48.711251 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:48.846955 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:48.855284 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-5b1fcf56-7ee4-48c4-a0e2-48256b3cb5ad tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.160431 Sep 29 02:29:48.855846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 599/1154] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:48 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:49.881482 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:49.882331 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:49.890335 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:49.890893 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:49.891401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:49.892212 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:49.892776 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:49.893265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:50.032641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:50.040940 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7741c237-d15c-4664-8d85-75366f7dcffd tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.164428 Sep 29 02:29:50.041514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 600/1155] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:49 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:51.079930 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:51.080693 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:51.087400 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:51.087879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:51.088307 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:51.088990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:51.089437 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:51.089856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:51.239856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:51.251497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6c628235-0a33-4726-b48a-3f08bcf00cde tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.177988 Sep 29 02:29:51.252417 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 601/1156] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:51 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:52.283784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:52.284485 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:52.286348 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:52.287143 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=8 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:52.293591 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:52.294108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:52.294537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:52.295220 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:52.295675 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:52.296087 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:52.300655 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:29:52.440246 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:52.452596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8c6174db-518b-4e67-b19e-e8acbb6e1341 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.174780 Sep 29 02:29:52.453377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 602/1157] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:52 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:53.478442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:53.479448 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:53.487973 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:53.488454 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:53.488879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:53.489562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:53.490032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:53.490450 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:53.627590 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:53.638545 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8426f5a5-b039-4076-ba37-e0195ebc0475 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.165399 Sep 29 02:29:53.639338 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 603/1158] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:53 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:54.666141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:54.667278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:54.676684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:54.677158 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:54.677586 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:54.678308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:54.678764 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:54.679180 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:54.816301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:54.824766 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ccb9a818-a091-4714-911d-a1577a802bb6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.165324 Sep 29 02:29:54.825302 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 604/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:54 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:55.848061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:55.848742 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:55.855829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:55.856310 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:55.856740 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:55.857423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:55.857871 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:55.858314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:55.996815 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:56.008420 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-2308f614-f06b-4f6c-8bf1-aa3c8df9faa4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.164072 Sep 29 02:29:56.009190 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 605/1160] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:55 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:57.035038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:57.035730 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:57.042825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:57.043315 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:57.043747 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:57.044445 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:57.044896 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:57.045317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:57.188321 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:57.197535 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-ac262ade-5992-4f5b-93ef-0a1279ecaaf5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.167383 Sep 29 02:29:57.198138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 606/1161] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:57 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:57.264594 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-29defe86-e628-4aea-93a4-96aa3fc97d57 req-4e1142f0-5812-43cf-a7c7-59f51331a14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b947685a-7d2f-4d2f-a45a-5a6a50d5fa69", "name": "network-vif-plugged", "status": "completed", "tag": "5c881b0f-39f9-45eb-a932-00ea21c3b8fa"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:29:57.277669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-29defe86-e628-4aea-93a4-96aa3fc97d57 req-4e1142f0-5812-43cf-a7c7-59f51331a14f service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:57.278387 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-29defe86-e628-4aea-93a4-96aa3fc97d57 req-4e1142f0-5812-43cf-a7c7-59f51331a14f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:57.279025 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-29defe86-e628-4aea-93a4-96aa3fc97d57 req-4e1142f0-5812-43cf-a7c7-59f51331a14f service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:57.295210 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-29defe86-e628-4aea-93a4-96aa3fc97d57 req-4e1142f0-5812-43cf-a7c7-59f51331a14f service nova] Creating event network-vif-plugged:5c881b0f-39f9-45eb-a932-00ea21c3b8fa for instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 on hv-cinder-73306 Sep 29 02:29:57.301587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-29defe86-e628-4aea-93a4-96aa3fc97d57 req-4e1142f0-5812-43cf-a7c7-59f51331a14f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102353 Sep 29 02:29:57.302290 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 607/1162] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:29:58.224429 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:58.225346 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:58.234064 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:58.234716 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:58.235289 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:58.236150 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:58.236623 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:58.237046 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:58.386954 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:58.395177 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-064c92bf-62b5-4f54-80ba-d1499b5d0c1c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1267 microversion: 2.1 time: 0.177075 Sep 29 02:29:58.395750 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 608/1163] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:58 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:59.421676 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:59.422879 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:59.433666 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:59.434510 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:59.435227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:59.436363 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:59.437114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:59.437817 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:59.589381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:59.597672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-8f50258f-8c6f-4226-93ba-32763643b0d2 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1454 microversion: 2.1 time: 0.182537 Sep 29 02:29:59.598288 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 609/1164] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:59 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:29:59.619841 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:29:59.620442 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:29:59.628054 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:59.628709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:59.629317 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:59.630174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:29:59.630619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:29:59.631169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:29:59.770470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:29:59.778978 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7d78b302-5c37-4a43-98bd-b3de55f50cbe tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1454 microversion: 2.1 time: 0.162746 Sep 29 02:29:59.779550 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 610/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:29:59 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:30:01.693540 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-1bd4bf1b-d99c-40a1-9158-0be5df0ac8ce req-7d8ffa03-221f-4694-8ca2-c9ec1e52062e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b947685a-7d2f-4d2f-a45a-5a6a50d5fa69", "tag": "5c881b0f-39f9-45eb-a932-00ea21c3b8fa"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:30:01.703494 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1bd4bf1b-d99c-40a1-9158-0be5df0ac8ce req-7d8ffa03-221f-4694-8ca2-c9ec1e52062e service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:30:01.704074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1bd4bf1b-d99c-40a1-9158-0be5df0ac8ce req-7d8ffa03-221f-4694-8ca2-c9ec1e52062e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:30:01.704743 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-1bd4bf1b-d99c-40a1-9158-0be5df0ac8ce req-7d8ffa03-221f-4694-8ca2-c9ec1e52062e service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:30:01.716359 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-1bd4bf1b-d99c-40a1-9158-0be5df0ac8ce req-7d8ffa03-221f-4694-8ca2-c9ec1e52062e service nova] Creating event network-changed:5c881b0f-39f9-45eb-a932-00ea21c3b8fa for instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 on hv-cinder-73306 Sep 29 02:30:01.722755 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-1bd4bf1b-d99c-40a1-9158-0be5df0ac8ce req-7d8ffa03-221f-4694-8ca2-c9ec1e52062e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033106 Sep 29 02:30:01.723077 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 611/1166] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:32:15.633170 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113d2e06-c93f-4a23-8b52-ef81092d5b28] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 29 02:32:15.633828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:32:15.634506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=50 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:32:15.635748 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 29 02:32:15.635910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Thu Sep 29 02:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:32:15.636976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 29 02:32:15.637114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Thu Sep 29 02:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:32:15.638252 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 29 02:32:15.638375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Thu Sep 29 02:32:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:32:15.645481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1648096204", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1964195389", "security_groups": [{"name": "tempest-secgroup-smoke-1913896121"}], "block_device_mapping_v2": [{"uuid": "50302d91-fa52-4365-b170-0264463ebb1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "97027d5c-275b-43e9-ab3b-3dc0aafb8749"}]}} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:32:15.767030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.network.neutron [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] validate_networks() for [('97027d5c-275b-43e9-ab3b-3dc0aafb8749', None, None, None, None, None)] {{(pid=120698) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 29 02:32:16.158859 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Flavor limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 29 02:32:16.159271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Image limits 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 29 02:32:16.159741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Flavor pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 29 02:32:16.160122 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Image pref 0:0:0 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 29 02:32:16.160522 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.virt.hardware [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120698) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 29 02:32:16.173080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:16.173752 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:16.174425 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:16.175375 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:16.175997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:16.176301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:16.196957 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for project e57890af7876437d9fddfea4a536a0d7. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 29 02:32:16.201625 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.quota [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Getting quotas for user bbb9be467f4947f4a203a3de6c37fa9a and project e57890af7876437d9fddfea4a536a0d7. Resources: {'instances', 'cores', 'ram'} {{(pid=120698) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 29 02:32:16.261580 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Going to run 1 instances... {{(pid=120698) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 29 02:32:16.264207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='50302d91-fa52-4365-b170-0264463ebb1c',volume_size=None,volume_type=None)] {{(pid=120698) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 29 02:32:16.405502 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-005b4715-f04e-43df-9fe0-fd4b2d338d1e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.774257 Sep 29 02:32:16.406166 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 612/1167] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 29 02:32:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 29 02:32:16.417548 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4436ca46-9836-481a-b5e4-0e0cef43ba68 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:16.418172 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4436ca46-9836-481a-b5e4-0e0cef43ba68 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:16.483470 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4436ca46-9836-481a-b5e4-0e0cef43ba68 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:16.491083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4436ca46-9836-481a-b5e4-0e0cef43ba68 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1095 microversion: 2.1 time: 0.077585 Sep 29 02:32:16.491641 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 613/1168] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:16 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:17.513239 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-75db7fb1-0b9d-4452-93d8-e7841d22268b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:17.513853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-75db7fb1-0b9d-4452-93d8-e7841d22268b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:17.540561 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [113d2e06-c93f-4a23-8b52-ef81092d5b28] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 54266. Sep 29 02:32:17.573784 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-75db7fb1-0b9d-4452-93d8-e7841d22268b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:17.580785 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-75db7fb1-0b9d-4452-93d8-e7841d22268b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1095 microversion: 2.1 time: 0.071587 Sep 29 02:32:17.581350 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 614/1169] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:17 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:18.604140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-733dbe74-aeb6-4302-9d37-f0243281c215 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:18.604640 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-733dbe74-aeb6-4302-9d37-f0243281c215 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:18.658018 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-733dbe74-aeb6-4302-9d37-f0243281c215 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:18.664931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-733dbe74-aeb6-4302-9d37-f0243281c215 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1095 microversion: 2.1 time: 0.065274 Sep 29 02:32:18.667587 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 615/1170] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:18 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:19.689823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-9438ac8c-894b-4870-ad24-b79cc816f4e6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:19.690439 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-9438ac8c-894b-4870-ad24-b79cc816f4e6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:19.746169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-9438ac8c-894b-4870-ad24-b79cc816f4e6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:19.754223 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-9438ac8c-894b-4870-ad24-b79cc816f4e6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1095 microversion: 2.1 time: 0.068404 Sep 29 02:32:19.754850 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 616/1171] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:19 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:20.779074 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:20.779816 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:20.787390 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:20.787857 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:20.788280 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:20.788960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:20.789404 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:20.789823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:20.852736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:20.860718 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fabf5ac-03cc-4829-b026-d27887ac6897 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1145 microversion: 2.1 time: 0.086431 Sep 29 02:32:20.861275 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 617/1172] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:20 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:21.884131 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:21.884825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:21.891514 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:21.892001 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:21.892489 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:21.893196 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:21.893653 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:21.894154 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:21.967360 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:21.975366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-f0e4088c-22af-4542-89e8-f4e57b55a883 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1211 microversion: 2.1 time: 0.095238 Sep 29 02:32:21.975950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 618/1173] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:21 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:22.999299 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:23.000119 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:23.007216 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:23.007694 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:23.008133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:23.008853 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:23.009499 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:23.009935 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:23.406235 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:23.414883 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-07203e0a-5421-4140-b392-0a7d4574678a tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.420075 Sep 29 02:32:23.415469 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 619/1174] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:22 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:23.432368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-cfa9b1b5-9a08-45c9-9e2d-eb5c9205d505 req-faab1a87-0855-43aa-b9b9-c56996d93e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0984a2a4-16c2-400d-8cf5-1d6c3eaaed93", "tag": "69fe5e09-1552-41f0-8e00-a2ddcb8e65d7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:32:23.442497 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cfa9b1b5-9a08-45c9-9e2d-eb5c9205d505 req-faab1a87-0855-43aa-b9b9-c56996d93e04 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:23.442965 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cfa9b1b5-9a08-45c9-9e2d-eb5c9205d505 req-faab1a87-0855-43aa-b9b9-c56996d93e04 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:23.443386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-cfa9b1b5-9a08-45c9-9e2d-eb5c9205d505 req-faab1a87-0855-43aa-b9b9-c56996d93e04 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:23.454525 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-cfa9b1b5-9a08-45c9-9e2d-eb5c9205d505 req-faab1a87-0855-43aa-b9b9-c56996d93e04 service nova] Creating event network-changed:69fe5e09-1552-41f0-8e00-a2ddcb8e65d7 for instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 on hv-cinder-73306 Sep 29 02:32:23.461320 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-cfa9b1b5-9a08-45c9-9e2d-eb5c9205d505 req-faab1a87-0855-43aa-b9b9-c56996d93e04 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032664 Sep 29 02:32:23.462395 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 620/1175] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:32:24.444826 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:24.445974 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:24.456568 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:24.457368 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:24.458104 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:24.459286 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:24.460033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:24.460735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:24.598312 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:24.606624 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-3935272f-88f9-4371-ba58-f6d0682b6387 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.169670 Sep 29 02:32:24.607214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 621/1176] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:24 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:25.633537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:25.634596 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:25.642977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:25.643463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:25.643892 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:25.644581 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:25.645054 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:25.645481 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:25.780354 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:25.792265 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-14d0f2d1-b13f-4e10-8f5a-3b5bded36130 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.164902 Sep 29 02:32:25.793004 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 622/1177] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:25 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:26.820045 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:26.821138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:26.824108 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=2 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:32:26.835209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:26.835993 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:26.836700 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:26.837825 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:26.838612 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:26.839305 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:26.998552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:27.006432 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-bc2979c6-b72b-4653-9d3d-d2e9d329372d tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.192930 Sep 29 02:32:27.007005 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 623/1178] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:26 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:28.034083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:28.035191 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:28.045719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:28.046242 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:28.046664 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:28.047351 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:28.047796 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:28.048214 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:28.180486 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:28.190378 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-cdeda924-ffcb-4b91-82c2-f34b98bc4d8e tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.163152 Sep 29 02:32:28.190961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 624/1179] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:28 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:29.217418 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:29.218266 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:29.226039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:29.226610 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:29.227133 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:29.227942 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:29.228476 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:29.228971 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:29.370141 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:29.382878 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1afeca83-8613-4405-9bd6-7e6770558502 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.171403 Sep 29 02:32:29.383584 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 625/1180] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:29 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:30.409353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:30.410227 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:30.412328 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell0:SELECT=14 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:32:30.420169 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:30.420759 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:30.421291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:30.422171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:30.422732 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:30.423253 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:30.576846 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:30.585174 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eb6af7f1-abc9-4453-b073-1af5920be2ba tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.181273 Sep 29 02:32:30.585739 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 626/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:30 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:31.608176 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:31.608788 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:31.615583 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:31.616071 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:31.616505 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:31.617198 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:31.617684 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:31.618140 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:31.761907 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:31.770688 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-017af6b8-c99d-41a1-b98f-8eedc72a0de3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.166895 Sep 29 02:32:31.771291 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 627/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:31 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:32.794534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:32.795319 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:32.801890 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:32.802352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:32.802786 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:32.803463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:32.803905 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:32.804314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:32.939725 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:32.947960 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-31036e45-c0e1-45df-a9b4-e69f57de5c8b tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.157391 Sep 29 02:32:32.948541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 628/1183] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:32 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:33.976976 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:33.977671 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:33.984617 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:33.985096 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:33.985521 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:33.986244 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:33.986736 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:33.987163 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:34.126373 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:34.136207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-4202ab2a-f992-4b89-9eca-5ffe2e9f9dc3 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.162841 Sep 29 02:32:34.137175 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 629/1184] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:33 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:32:35.163369 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:35.164366 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:35.175533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:35.176318 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:35.177027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:35.178206 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:35.178950 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:35.179646 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:35.328964 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:35.336771 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c8ea974b-26b6-4946-9dee-564f03800f6c tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.179985 Sep 29 02:32:35.337377 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 630/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:35 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:35.888998 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-646e7439-6def-47f1-af12-5220c92af9ab req-36da1154-3a3b-41b9-9036-30ac838b4fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0984a2a4-16c2-400d-8cf5-1d6c3eaaed93", "name": "network-vif-plugged", "status": "completed", "tag": "69fe5e09-1552-41f0-8e00-a2ddcb8e65d7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:32:35.903964 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-646e7439-6def-47f1-af12-5220c92af9ab req-36da1154-3a3b-41b9-9036-30ac838b4fa4 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:35.904461 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-646e7439-6def-47f1-af12-5220c92af9ab req-36da1154-3a3b-41b9-9036-30ac838b4fa4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:35.904881 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-646e7439-6def-47f1-af12-5220c92af9ab req-36da1154-3a3b-41b9-9036-30ac838b4fa4 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:35.917117 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-646e7439-6def-47f1-af12-5220c92af9ab req-36da1154-3a3b-41b9-9036-30ac838b4fa4 service nova] Creating event network-vif-plugged:69fe5e09-1552-41f0-8e00-a2ddcb8e65d7 for instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 on hv-cinder-73306 Sep 29 02:32:35.922619 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-646e7439-6def-47f1-af12-5220c92af9ab req-36da1154-3a3b-41b9-9036-30ac838b4fa4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039750 Sep 29 02:32:35.923314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 631/1186] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:32:36.362333 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:36.363070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:36.370309 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:36.370791 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:36.371224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:36.371925 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:36.372374 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:36.372793 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:36.538970 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:36.547593 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b0a91595-faa1-4bc7-bfc8-0e0d28e65ede tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.189849 Sep 29 02:32:36.548278 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 632/1187] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:36 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:32:37.579931 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:37.580603 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:37.587527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:37.588009 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:37.588446 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:37.589138 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:37.589590 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:37.590023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:37.724975 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:37.733111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-d31bfc3c-efa9-4e00-803f-27031124df04 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1267 microversion: 2.1 time: 0.157228 Sep 29 02:32:37.733686 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 633/1188] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:37 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:38.761145 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:38.762311 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:38.773652 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:38.774528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:38.775467 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:38.776599 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:38.777343 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:38.778082 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:38.798032 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=100 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:32:38.910961 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:38.919393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-facb4614-1fe9-4419-a2b3-5af4a0121cdb tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1454 microversion: 2.1 time: 0.164858 Sep 29 02:32:38.919963 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 634/1189] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:38 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:32:38.947997 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:32:38.948606 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:32:38.954644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:38.955128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:38.955562 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:38.956253 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:38.956708 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:38.957165 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:39.104334 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:32:39.112945 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-6d46b780-ccc7-44e9-9119-1a7d9c2deb0f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1454 microversion: 2.1 time: 0.168572 Sep 29 02:32:39.113534 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 635/1190] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:32:38 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:32:40.818573 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-6cddbca1-114e-4406-b491-dbe7550a0fcb req-961b521f-a7df-43d7-9e61-78fa0a668310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0984a2a4-16c2-400d-8cf5-1d6c3eaaed93", "tag": "69fe5e09-1552-41f0-8e00-a2ddcb8e65d7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:32:40.828547 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6cddbca1-114e-4406-b491-dbe7550a0fcb req-961b521f-a7df-43d7-9e61-78fa0a668310 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:32:40.829020 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6cddbca1-114e-4406-b491-dbe7550a0fcb req-961b521f-a7df-43d7-9e61-78fa0a668310 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:32:40.829480 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-6cddbca1-114e-4406-b491-dbe7550a0fcb req-961b521f-a7df-43d7-9e61-78fa0a668310 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:32:40.841737 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-6cddbca1-114e-4406-b491-dbe7550a0fcb req-961b521f-a7df-43d7-9e61-78fa0a668310 service nova] Creating event network-changed:69fe5e09-1552-41f0-8e00-a2ddcb8e65d7 for instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 on hv-cinder-73306 Sep 29 02:32:40.847111 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-6cddbca1-114e-4406-b491-dbe7550a0fcb req-961b521f-a7df-43d7-9e61-78fa0a668310 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033146 Sep 29 02:32:40.848047 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 636/1191] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:32:42.745605 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:32:42.746603 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:32:42.748307 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:32:42.748561 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:32:49.605884 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:32:49.606874 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:32:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:34:44.316359 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR oslo.messaging._drivers.impl_rabbit [-] [113d2e06-c93f-4a23-8b52-ef81092d5b28] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 29 02:34:44.317033 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:34:44.317823 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG dbcounter [-] [120698] Writing DB stats nova_cell1:SELECT=10 {{(pid=120698) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 29 02:34:44.325626 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:44.326393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:44.333741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:44.334241 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:44.334674 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:44.336159 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:44.336616 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:44.337039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:44.362741 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:34:44.450128 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-787c97ad-9a3c-4fba-a2b4-3f7114449b8f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 204 len: 0 microversion: 2.1 time: 0.136110 Sep 29 02:34:44.450870 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 637/1192] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:34:44 2022] DELETE /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:34:44.527027 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-5c8ae96e-a1b4-40de-85cd-239a0132735f req-6b3aaa90-0f1a-4111-9958-e03fc0b6b392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0984a2a4-16c2-400d-8cf5-1d6c3eaaed93", "tag": "69fe5e09-1552-41f0-8e00-a2ddcb8e65d7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:34:44.536709 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5c8ae96e-a1b4-40de-85cd-239a0132735f req-6b3aaa90-0f1a-4111-9958-e03fc0b6b392 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:44.537182 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5c8ae96e-a1b4-40de-85cd-239a0132735f req-6b3aaa90-0f1a-4111-9958-e03fc0b6b392 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:44.537604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-5c8ae96e-a1b4-40de-85cd-239a0132735f req-6b3aaa90-0f1a-4111-9958-e03fc0b6b392 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:44.549095 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-5c8ae96e-a1b4-40de-85cd-239a0132735f req-6b3aaa90-0f1a-4111-9958-e03fc0b6b392 service nova] Creating event network-changed:69fe5e09-1552-41f0-8e00-a2ddcb8e65d7 for instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 on hv-cinder-73306 Sep 29 02:34:44.554814 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-5c8ae96e-a1b4-40de-85cd-239a0132735f req-6b3aaa90-0f1a-4111-9958-e03fc0b6b392 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102748 Sep 29 02:34:44.555500 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 638/1193] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:34:44.560337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:44.561023 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:44.567080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:44.567552 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:44.567965 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:44.568650 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:44.569109 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:44.569721 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:44.749781 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:34:44.758067 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-7bfeee7b-4b9e-469f-a29f-994466ee22a4 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1579 microversion: 2.1 time: 0.201465 Sep 29 02:34:44.774484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 639/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:44 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:34:45.786089 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:45.786895 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:45.797114 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO oslo.messaging._drivers.impl_rabbit [-] [113d2e06-c93f-4a23-8b52-ef81092d5b28] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 54392. Sep 29 02:34:45.802889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:45.803367 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:45.803838 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:45.804648 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:45.805092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:45.805506 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:45.970271 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:34:45.979401 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e3e836a8-9c3d-4d1e-ab33-64c1b9b92631 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1579 microversion: 2.1 time: 0.198436 Sep 29 02:34:45.979977 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 640/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:45 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1579 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 29 02:34:47.016995 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-914cdfb0-cecd-4be9-85b5-61f4d9f4f1b1 req-7ff48c0e-f675-4134-a350-9695c407c876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0984a2a4-16c2-400d-8cf5-1d6c3eaaed93", "name": "network-vif-deleted", "tag": "69fe5e09-1552-41f0-8e00-a2ddcb8e65d7"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:34:47.027030 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-914cdfb0-cecd-4be9-85b5-61f4d9f4f1b1 req-7ff48c0e-f675-4134-a350-9695c407c876 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:47.027501 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-914cdfb0-cecd-4be9-85b5-61f4d9f4f1b1 req-7ff48c0e-f675-4134-a350-9695c407c876 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:47.027919 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-914cdfb0-cecd-4be9-85b5-61f4d9f4f1b1 req-7ff48c0e-f675-4134-a350-9695c407c876 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:47.042413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-914cdfb0-cecd-4be9-85b5-61f4d9f4f1b1 req-7ff48c0e-f675-4134-a350-9695c407c876 service nova] Creating event network-vif-deleted:69fe5e09-1552-41f0-8e00-a2ddcb8e65d7 for instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 on hv-cinder-73306 Sep 29 02:34:47.047381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-914cdfb0-cecd-4be9-85b5-61f4d9f4f1b1 req-7ff48c0e-f675-4134-a350-9695c407c876 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088336 Sep 29 02:34:47.047972 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 641/1196] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 29 02:34:47.053248 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:47.054217 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:47.060171 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:47.060662 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:47.061083 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:47.061749 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:47.062225 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:47.062636 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:47.125293 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:34:47.133538 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-db70e8d3-611a-4113-865c-8d3c6ecc8447 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 200 len: 1226 microversion: 2.1 time: 0.084452 Sep 29 02:34:47.134129 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 642/1197] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:47 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:34:48.160802 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:48.161872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:48.172920 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:48.173722 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:48.174533 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:48.175621 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:48.176379 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:48.177459 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:48.193409 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] HTTP exception thrown: Instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 could not be found. Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Request method failure captured: Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 HTTP/1.1 Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQJTmhowkilXKKT1h1wRDI-siDUXd2NIpVS-IZE_MQWdMa3s7_ar2L6exoIo6PQ_bA5NhE8sv28KwkvNqPBAgGuVScHY5qYxPn8sPjayBYdTOswh1ow0Kn25stwXhwRGvK00K6q8cYvbAGcU-NGZ4v-x_14-noqRpHt3Tfa3bH0MCRU Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:34:48.195126 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: bbb9be467f4947f4a203a3de6c37fa9a Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 could not be found. Sep 29 02:34:48.196990 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '0984a2a4-16c2-400d-8cf5-1d6c3eaaed93'} Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 could not be found. Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:34:48.198092 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 could not be found. Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 could not be found. Sep 29 02:34:48.200070 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:48.201829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Returning 404 to user: Instance 0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:34:48.201829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-b41f4c37-88e3-4cc3-bb84-e6204a490b23 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93" status: 404 len: 111 microversion: 2.1 time: 0.042398 Sep 29 02:34:48.201829 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 643/1198] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:48 2022] GET /compute/v2.1/servers/0984a2a4-16c2-400d-8cf5-1d6c3eaaed93 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:34:51.299236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:51.299867 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:51.307249 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:51.307815 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:51.308463 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:51.309244 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:51.309795 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:51.310337 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:51.342669 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Going to try to terminate instance {{(pid=120698) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 29 02:34:51.429236 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-fa65a8c0-6eda-4172-b126-adb6009d4a1f tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 204 len: 0 microversion: 2.1 time: 0.133316 Sep 29 02:34:51.429513 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 644/1199] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:34:51 2022] DELETE /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 29 02:34:51.436224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-31989c2c-63e5-4d25-8334-3e8a509863ac req-eeccd8df-dae2-416d-bf8d-3f099c6b1c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b947685a-7d2f-4d2f-a45a-5a6a50d5fa69", "tag": "5c881b0f-39f9-45eb-a932-00ea21c3b8fa"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:34:51.445484 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31989c2c-63e5-4d25-8334-3e8a509863ac req-eeccd8df-dae2-416d-bf8d-3f099c6b1c2b service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:51.445958 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31989c2c-63e5-4d25-8334-3e8a509863ac req-eeccd8df-dae2-416d-bf8d-3f099c6b1c2b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:51.446413 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-31989c2c-63e5-4d25-8334-3e8a509863ac req-eeccd8df-dae2-416d-bf8d-3f099c6b1c2b service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:51.457783 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-31989c2c-63e5-4d25-8334-3e8a509863ac req-eeccd8df-dae2-416d-bf8d-3f099c6b1c2b service nova] Creating event network-changed:5c881b0f-39f9-45eb-a932-00ea21c3b8fa for instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 on hv-cinder-73306 Sep 29 02:34:51.462799 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-31989c2c-63e5-4d25-8334-3e8a509863ac req-eeccd8df-dae2-416d-bf8d-3f099c6b1c2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031628 Sep 29 02:34:51.463396 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 645/1200] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:34:51.469361 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:51.470080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:51.476301 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:51.476780 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:51.477207 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:51.477889 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:51.478351 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:51.478888 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:51.614062 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:34:51.622221 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-013c4ee1-e6f8-480c-bdf5-fe0425f7c6a6 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1579 microversion: 2.1 time: 0.157667 Sep 29 02:34:51.623219 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 646/1201] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:51 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:34:52.647415 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:52.648152 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:52.655250 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:52.655714 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:52.656148 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:52.656856 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:52.657308 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:52.657735 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:52.832833 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:34:52.841029 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-913d15f1-d6b2-4bed-91e5-32899fc8ccab tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1579 microversion: 2.1 time: 0.198816 Sep 29 02:34:52.841604 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 647/1202] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:52 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1579 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:34:53.364296 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [req-2f64a1e8-52c9-492f-b17b-e7ff0dd8d0c5 req-46617104-f863-4b02-b51b-2d53ddb07587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b947685a-7d2f-4d2f-a45a-5a6a50d5fa69", "name": "network-vif-deleted", "tag": "5c881b0f-39f9-45eb-a932-00ea21c3b8fa"}]} {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 29 02:34:53.377599 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2f64a1e8-52c9-492f-b17b-e7ff0dd8d0c5 req-46617104-f863-4b02-b51b-2d53ddb07587 service nova] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:53.378080 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2f64a1e8-52c9-492f-b17b-e7ff0dd8d0c5 req-46617104-f863-4b02-b51b-2d53ddb07587 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:53.378544 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [req-2f64a1e8-52c9-492f-b17b-e7ff0dd8d0c5 req-46617104-f863-4b02-b51b-2d53ddb07587 service nova] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:53.394755 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.compute.server_external_events [req-2f64a1e8-52c9-492f-b17b-e7ff0dd8d0c5 req-46617104-f863-4b02-b51b-2d53ddb07587 service nova] Creating event network-vif-deleted:5c881b0f-39f9-45eb-a932-00ea21c3b8fa for instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 on hv-cinder-73306 Sep 29 02:34:53.401279 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [req-2f64a1e8-52c9-492f-b17b-e7ff0dd8d0c5 req-46617104-f863-4b02-b51b-2d53ddb07587 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040709 Sep 29 02:34:53.402528 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 648/1203] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 29 02:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 29 02:34:53.865391 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:53.866084 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:53.873209 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:53.873622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:53.874078 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:53.874762 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:53.875186 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:53.875622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:53.907016 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:53.907410 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:53.907835 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:53.908393 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.objects.instance [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lazy-loading 'fault' on Instance uuid b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 {{(pid=120698) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 29 02:34:53.952657 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.policy [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbb9be467f4947f4a203a3de6c37fa9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e57890af7876437d9fddfea4a536a0d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120698) authorize /opt/stack/nova/nova/policy.py:199}} Sep 29 02:34:53.964399 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-897858dc-5bab-4a5d-9c81-9df128927116 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 200 len: 1231 microversion: 2.1 time: 0.102978 Sep 29 02:34:53.965381 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 649/1204] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:53 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 29 02:34:54.997769 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:54.998622 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: b947685a-7d2f-4d2f-a45a-5a6a50d5fa69] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:55.006142 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:55.006658 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:55.007137 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:55.007906 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:55.008405 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:55.008872 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:55.024537 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] HTTP exception thrown: Instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 could not be found. Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Request method failure captured: Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 HTTP/1.1 Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQJTmhowkilXKKT1h1wRDI-siDUXd2NIpVS-IZE_MQWdMa3s7_ar2L6exoIo6PQ_bA5NhE8sv28KwkvNqPBAgGuVScHY5qYxPn8sPjayBYdTOswh1ow0Kn25stwXhwRGvK00K6q8cYvbAGcU-NGZ4v-x_14-noqRpHt3Tfa3bH0MCRU Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:34:55.026423 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: bbb9be467f4947f4a203a3de6c37fa9a Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 could not be found. Sep 29 02:34:55.028386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': 'b947685a-7d2f-4d2f-a45a-5a6a50d5fa69'} Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 could not be found. Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:34:55.029383 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 could not be found. Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 could not be found. Sep 29 02:34:55.031055 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.032527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Returning 404 to user: Instance b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:34:55.032527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-eabf416f-1c6c-405b-bd87-ad1f53bb8312 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69" status: 404 len: 111 microversion: 2.1 time: 0.036907 Sep 29 02:34:55.032527 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 650/1205] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:54 2022] GET /compute/v2.1/servers/b947685a-7d2f-4d2f-a45a-5a6a50d5fa69 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:34:55.489224 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:55.489910 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:55.499313 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:55.500038 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:55.500618 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:55.501618 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:55.502353 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:55.502991 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:55.519647 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] HTTP exception thrown: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Request method failure captured: Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: DELETE /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 HTTP/1.1 Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQJTmhowkilXKKT1h1wRDI-siDUXd2NIpVS-IZE_MQWdMa3s7_ar2L6exoIo6PQ_bA5NhE8sv28KwkvNqPBAgGuVScHY5qYxPn8sPjayBYdTOswh1ow0Kn25stwXhwRGvK00K6q8cYvbAGcU-NGZ4v-x_14-noqRpHt3Tfa3bH0MCRU Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:34:55.521188 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: bbb9be467f4947f4a203a3de6c37fa9a Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.523039 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '80f616df-79c4-478c-a52c-a9f9329912f6'} Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:34:55.524015 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.525644 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.527541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Returning 404 to user: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:34:55.527541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-1fd497e1-9907-43c1-b007-d0a6c3ccc741 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "DELETE /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 404 len: 111 microversion: 2.1 time: 0.039820 Sep 29 02:34:55.527541 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 651/1206] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 29 02:34:55 2022] DELETE /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 29 02:34:55.531061 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:55.531670 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.compute.api [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] [instance: 80f616df-79c4-478c-a52c-a9f9329912f6] Fetching instance by UUID {{(pid=120698) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 29 02:34:55.537770 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:55.538285 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:55.538719 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:55.539443 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Acquiring lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 29 02:34:55.539894 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 29 02:34:55.540314 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG oslo_concurrency.lockutils [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Lock "2d22be5e-d810-4cd6-a5aa-d9b54e2a8a07" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 29 02:34:55.554828 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.wsgi [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] HTTP exception thrown: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Request method failure captured: Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: request: GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 HTTP/1.1 Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept: application/json Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Accept-Encoding: identity Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Connection: close Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Length: 0 Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Content-Type: application/json Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Host: 10.222.0.61 Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: Openstack-System-Scope: None Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: User-Agent: python-urllib3/1.26.12 Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Auth-Token: gAAAAABjNQJTmhowkilXKKT1h1wRDI-siDUXd2NIpVS-IZE_MQWdMa3s7_ar2L6exoIo6PQ_bA5NhE8sv28KwkvNqPBAgGuVScHY5qYxPn8sPjayBYdTOswh1ow0Kn25stwXhwRGvK00K6q8cYvbAGcU-NGZ4v-x_14-noqRpHt3Tfa3bH0MCRU Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Id: None Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Domain-Name: None Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Identity-Status: Confirmed Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Is-Admin-Project: True Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Id: default Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Domain-Name: Default Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Project-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Role: member,reader Sep 29 02:34:55.556352 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Roles: member,reader Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e57890af7876437d9fddfea4a536a0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Id: e57890af7876437d9fddfea4a536a0d7 Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-Tenant-Name: tempest-TestVolumeBootPattern-2085693106 Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Id: default Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Domain-Name: Default Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Id: bbb9be467f4947f4a203a3de6c37fa9a Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: X-User-Name: tempest-TestVolumeBootPattern-2085693106-project Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: method: > Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: exception: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.558167 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: action_args: {'id': '80f616df-79c4-478c-a52c-a9f9329912f6'} Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 29 02:34:55.559526 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. Sep 29 02:34:55.561208 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: ERROR nova.api.openstack.wsgi Sep 29 02:34:55.562749 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Returning 404 to user: Instance 80f616df-79c4-478c-a52c-a9f9329912f6 could not be found. {{(pid=120698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 29 02:34:55.562749 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-c59f5cbc-2294-4756-9d3b-9d4a33221fd5 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6" status: 404 len: 111 microversion: 2.1 time: 0.030381 Sep 29 02:34:55.562749 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 652/1207] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 29 02:34:55 2022] GET /compute/v2.1/servers/80f616df-79c4-478c-a52c-a9f9329912f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 29 02:34:56.884745 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: DEBUG nova.api.openstack.wsgi [None req-e8187199-73be-4a40-897a-ad9c45a6d782 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] Calling method '.version_select at 0x7f404d8d6700>' {{(pid=120698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 29 02:34:56.910672 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: INFO nova.api.openstack.requestlog [None req-e8187199-73be-4a40-897a-ad9c45a6d782 tempest-TestVolumeBootPattern-2085693106 tempest-TestVolumeBootPattern-2085693106-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1964195389" status: 202 len: 0 microversion: 2.1 time: 0.029800 Sep 29 02:34:56.911386 dv-cinder-733062-36-iscsi devstack@n-api.service[120698]: [pid: 120698|app: 0|req: 653/1208] 10.222.0.61 () {58 vars in 1263 bytes} [Thu Sep 29 02:34:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1964195389 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 29 02:36:02.768485 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:36:02.768986 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:36:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:36:02.770602 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:36:02.770773 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:36:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:36:09.620227 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:36:09.621312 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:39:22.783366 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:39:22.784444 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:39:22.786456 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:39:22.786707 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:39:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!! Sep 29 02:39:29.633739 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 29 02:39:29.634378 dv-cinder-733062-36-iscsi devstack@n-api.service[120699]: Thu Sep 29 02:39:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.61) !!!